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FOREWORD 


A  joint-service  coordinated  effort  is  underway  to  develop  a  computerized  adaptive 
testing  (CAT)  system  and  to  evaluate  its  potential  for  use  in  the  military  entrance 
processing  stations  as  a  replacement  for  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  printed  tests.  The  Navy  Personnel  Research  and  Development  Center  has  been 
designated  lead  laboratory  for  this  effort. 

This  report,  which  was  sponsored  by  the  Commandant  of  the  Marine  Corps  (MPI-20) 
and  performed  by  the  Office  of  Personnel  Managment  (OPM),  is  the  fifth  in  a  series  being 
issued  under  the  CAT  project.  It  describes  a  theoretical  foundation  on  which  the  adaptive 
administration  of  aptitude  tests  may  be  based,  and  is  intended  for  use  by  professionals  in 
the  field  of  psychometrics.  The  previous  reports  issued  are  listed  below: 

1.  McBride,  3.  R.  Computerized  adaptive  testing  project:  Objectives  and  require¬ 
ments  (NPRDC  Tech.  Note  82-22),  July  1982.  - - a - 

2.  Croll,  P.  R.  Computerized  adaptive  testing  system  design:  Preliminary  design 

characteristics  (NPRDC  Tech.  Rep.  82-52),  July  1982?  (AD-A118  495) - - 

3.  Wetzel,  C.  D.,  &  McBride,  3.  R.  Influence  of  fallible  item  parameters  on  test 

information  during  adaptive  testing  (NPRDC  Tech.  Rep.  83-15),  April  1983. - 

4.  Moreno,  K.  E.,  Wetzel,  C.  D.,  &  McBride,  3.  R.  Relationship  between 
cO-rresPonding  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  and  computerized 

adaptive  testing  (CAT)  subtests  (NPRDC  Tech.  Rep.  83-27).  August  1983 - - 

This  report  was  initially  conceived  and  planned  at  OPM  when  tailored  testing  was 
proposed  for  federal  civil  service  examining  on  a  widespread  basis.  Dr.  Neil  3.  Dorans 
p  aye  a  significant  part  in  the  original  planning,  outlining,  and  writing  of  early  versions 
of  the  report.  Several  persons  provided  valuable  reviews  and  comments  on  earlier 
versions  of  the  report,  including  Professor  Hubert  E.  Brogden  of  Purdue  University 
Dr.  Charles  H.  Anderson  of  OPM,  and  Professor  Bert  F.  Green  of  the  3ohns  Hopkins 
University.  Editorial  assistance  was  capably  provided  by  Cynthia  L.  Clark  of  OPM, 
Washington,  DC.  ’ 


The  contracting  officer's  technical  representative  was  Dr.  3ames  R.  McBride. 
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Commanding  Officer 
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INTRODUCTION 


Tailored  testing  is  a  mode  of  pyschological  testing  where  examinees  interact  with  a  computer  to  answer 
a  series  of  questions,  each  prompted  by  the  correctness  or  incorrectness  of  responses  to  previous  questions.  This 
mode  of  testing  has  become  the  focus  of  considerable  activity  during  the  past  decade.  The  impetus  for  this 
activity  has  been  the  recognition  of  the  potential  of  tailored  testing  to  provide  substantial  benefits  along  with 
reductions  in  the  overall  cost  of  testing.  Marked  improvements  in  measurement,  ease  of  administration,  security 
of  test  materials,  and  examinee  convenience  are  frequently  mentioned  as  major  potential  benefits.  Reductions 
in  the  overall  costs  of  testing  are  possible  because  of  recent  and  dramatic  advances  in  computer  technology. 

This  activity  has  produced  an  extensive  literature.  For  familiarity  with  its  scope,  the  interested  reader  is 
referred  to  the  proceedings  of  four  conferences  devoted  either  partially  or  completely  to  tailored  testing  (Holtzman, 
1970;  Clark,  1976;  Weiss,  1978,  and  Weiss,  1980). 

The  preferred  basis  for  tailored  testing  is  latent  trait  theory.  In  the  summer  of  1977,  the  Journal  of 
Educational  Measurement  published  a  thematic  issue  on  the  subject.  This  issue  might  also  be  consulted  for 
further  background.  In  particular,  one  article  (Urry,  1977)  deals  exclusively  with  tailored  testing.  In  this  article 
the  author  reports  the  results  of  an  empirical  study  where  tailored  testing  was  conducted  until  the  reliability  of 
the  test  scores  from  this  process  matched  the  reliability  of  a  particular  conventional  paper-and-pencil  test.  It  was 
found  that  tailored  testing  required  80%  fewer  items  than  the  conventional  testing  to  achieve  the  matched  reliability. 

The  particular  algorithm  used  for  the  tailoring  of  tests  in  that  empirical  study  will  be  derived,  explained, 
and  numerically  illustrated  in  the  present  report.  The  algorithm  is  based  on  a  three-parameter  normal  ogive 
submodel  which,  along  with  the  two-parameter  normal  ogive  submodel,  will  be  formally  derived  in  this  report. 
These  submodels  are  derived  from  the  more  familiar  model  for  a  single  common  factor.  The  three-parameter 
submodel  is  applicable  to  multiple-choice  items.  In  certain  circumstances,  the  data  bases  for  multiple-choice 
items  are  now  sufficient  for  the  implementation  of  tailored  testing.  The  data  bases  for  free-response  (short  answer) 
items  do  not  now  enjoy  this  status  However,  when  tailored  testing  is  implemented  with  multiple-choice  data 
bases,  the  active  involvement  of  the  computer  facilitates  the  development  of  free-response  data  bases.  This 
involvement  introduces  the  required  flexibility  into  the  scoring  of  items.  Since  the  two-parameter  normal  ogive 
submodel  is  applicable  to  free-response  (short  answer)  items,  it  then  has  possible  future  applications.  Also,  a 
discussion  of  the  two-parameter  submodel  provides  the  necessary  prologue  to  an  understanding  of  the  three- 
parameter  submodel. 

In  this  report  selection  theory  (Lawley,  1943)  is  used  as  the  theoretical  framework  for  the  development 
of  tailored  testing  algorithms.  This  framework  possesses  conceptual  utility.  The  process  of  tailored  testing  is 
presented  as  analogous  to  selections  and  rejections  on  a  series  of  continuous  variables  that  are  related  to  ability, 
the  variable  of  primary  interest.  In  this  case,  the  series  is  purposefully  chosen.  The  purpose  is  to  obtain  sub¬ 
populations  that  are  homogeneous  with  respect  to  ability.  The  binary  scores  on  items — one  for  a  correct  answer 
and  zero  for  an  incorrect  answer — when  placed  in  the  perspective  of  the  model  for  a  single  common  factor, 
ability,  are  viewed  as  analogues  of  selection  and  rejection  on  continuous  variables  that  are  usually  observed 
under  this  basic  model. 

Given  this  theoretical  as  well  as  conceptual  framework,  the  estimates  of  ability  become  the  means  of 
ability  for  the  subpopulations  that  would  have  resulted  from  the  purposeful  series  of  selections  and  rejections 
indicated  by  the  patterns  of  binary  scores.  The  variances  of  these  ability  estimates  become  the  restricted  variances 
of  ability  for  the  resulting  subpopuiations.  Precision  in  tailored  testing  is  viewed  as  the  analogue  of  severe 
restriction  in  range  or  homogeneity  with  respect  to  the  variable  of  primary  interest  for  the  resultant  subpopulations. 

The  exposition  in  this  report  deals  with  the  basic  model,  the  normal  ogive  submodels  that  derive 
from  this  basic  model;  the  tailored  testing  process;  the  tailoring  algorithms  that  are  derived  from  selection  theory; 
and  the  basis  for  the  control  of  these  algorithms  in  an  interactive  tailoring  system.  This  basis  of  control  also  derives 
from  selection  theory. 

In  Chapter  1,  the  model  for  a  single  common  factor  will  be  reviewed.  This  basic  model  assumes  that 
observed  random  variables  can  be  decomposed  into  a  common  factor  (true  score)  component,  and  a  unique  (error 
score)  component.  In  Chapters  2  and  3  it  will  be  assumed  that  normally  distributed  random  variables,  which 
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might  be  observed,  completely  determine  the  binary  scores  on  items,  that  is,  a  zero  for  an  incorrect  answer  and 
a  one  for  a  correct  answer.  Given  the  model  for  a  single  common  factor,  the  manner  of  this  determination  gives 
rise  to  the  normal  ogive  submodels,  in  particular,  the  two-  and  three-parameter  cases.  Some  further  consequences 
of  binary  scoring  will  be  developed  for  each  case.  These  developments  incorporate  brief  reviews  of  univariate 
and  multivariate  normal  distributions.  Some  important  results  are  then  obtained  which  are  required  in  subsequent 
derivation. 

In  Chapter  4  a  brief  introduction  is  provided  for  the  tailoring  process.  In  Chapter  5  the  analogy  is  drawn 
between  the  assumed  basis  of  binary  scores  and  the  process  of  selection  or  rejection.  Tailored  testing  algorithms 
are  then  derived  from  selection  theory  for  both  normal  ogive  submodels.  Each  algorithm  sequentially  provides 
(a)  the  choice  of  item,  (b)  the  ability  estimate,  and  (c)  the  variance  of  the  ability  estimate.  The  principle  of 
invariance  is  illustrated  with  respect  to  these  algorithms.  In  Chapter  6,  the  recursive  nature  of  the  derived 
formulation  is  demonstrated;  and  the  identity  of  this  derived  formulation  to  previously  developed  Bayesian 
procedures  (Owen,  1975)  is  established.  It  is  hoped  that  these  non-Bayesian  developments  will  improve  the 
accessibility  of  these  procedures  for  psychometricians  who  are  comfortable  with  selection  theory,  yet  unfamiliar 
with  Bayesian  statistics  and  terminology.  In  Chapter  7  the  implications  of  selection  theory  for  termination  rules 
in  tailored  testing  are  discussed;  and  the  relationship  between  equiprecision  in  ability  estimation  as  achieved 
through  termination  rules  and  tailored  test  reliability  is  developed.  Termination  rules  are  derived  from  a  particular 
submodel  given  all  of  its  various  assumptions.  One  then  has  the  means  of  assessing  the  validity  of  the  particular 
submodel  and  all  of  its  various  assumptions.  These  rules  forecast  or  predict  various  observable  results.  The 
results  predicted  by  the  termination  rules  can  be  compared  with  those  actually  obtained.  In  the  aforementioned 
study  (Urry,  1977),  the  obtained  results  were  predicted  very  well  from  the  termination  rules.  In  this  instance  the 
three-parameter  normal  ogive  submodel  was,  thus,  found  to  be  valid  for  multiple-choice  items.  A  valid  submodel 
ensures  that  termination  rules  are  informative;  and  informative  termination  rules  are  essential  to  the  development 
of  an  interactive  tailored  testing  system.  This  testing  is  conducted  individually;  but  normative  results  must  be 
predictable  in  order  to  complete  the  testing  of  each  examinee  effectively.  The  developments  in  this  chapter  will 
be  given  further  elaboration  in  Part  II,  a  subsequent  report.  This  elaboration  will  enable  multiple  ability  applications 
of  tailored  testing.  In  Chapter  8,  a  numerical  example  is  provided  for  an  individually  tailored  test. 

A  subsequent  report  will  treat  ability  estimation  in  data  sets  from  conventional  paper-and-pencil  testing; 
item  parameter  estimation  for  data  sets  from  both  conventional  and  tailored  testing;  multiple  ability  applications 
of  tailored  testing;  and  some  indispensable  allied  topics — namely,  simulation  research  for  both  the  unidimensional 
and  multidimensional  cases  and  procedures  for  psychometric  quality  control.  While  this  report  is  concerned  mainly  with 
basic  developments,  the  subsequent  report  will  deal  more  directly  with  applied  considerations. 

In  order  to  understand  this  report,  the  reader  should  have  a  thorough  familiarity  with  scalar  and  matrix 
algebra.  A  working  knowledge  of  calculus  would  be  helpful;  but  the  expositions,  particularly  in  Chapters  2,  3 
and  5,  attempt  to  avoid  this  requirement  by  summarizing  and  illustrating  the  important  results  from  calculus. 
The  derivation  of  these  results  is  presented  subsequently  in  sections  entitled  “Mathematical  Proofs.”  In  Chapter 
5,  the  results  of  lengthy  and  detailed  algebraic  developments  will  also  be  summarized  and  illustrated.  These 
lengthy  developments  will  likewise  be  presented  in  the  section  entitled  “Mathematical  Proofs.”  The  “Mathe¬ 
matical  Proofs”  sections  may  then  be  omitted  by  the  reader  without  loss  of  continuity. 
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1.  THE  BASIC  MODEL 


1.1  A  Model  for  a  Single  Common  Factor 

The  process  of  tailored  testing  as  described  here  entails  the  use  of  a  simple  model  with  straightforward, 
perhaps  strong,  assumptions.  The  model  involves  a  single  common  factor.  It  can  be  viewed  as  a  variant  of  a 
special  case  of  a  general  model  for  the  analysis  of  covariance  structures  (Joreskog,  1978),  specifically  a  model 
for  “congeneric”  items. 

The  application  of  this  model  to  test  items  requires  some  additional  consideration  that  will  be  given  in 
Chapters  2  and  3.  Derivations  in  the  present  chapter  will  show  that  the  common  factor  model  assumes  observed 
variables  to  be  continuous  variables;  whereas  test  items  typically  produce  binary  variables.  That  is  to  say,  items 
are  scored  zero  or  one  alternatively  denoting  incorrect  or  correct  answers.  In  order  to  apply  the  model  to  binary 
items,  it  is  then  necessary  to  assume  that  continuous  random  variables  underlie  and  completely  determine  the 
binary  random  variables  represented  by  binary  item  scores.  In  Chapters  2  and  3,  continuous  random  variables 
are  assumed  to  completely  determine  the  binary  random  variables  produced  by  both  the  free-response  (short 
answer)  item  and  the  more  familiar  multiple-choice  item.  The  manner  in  which  a  continuous  random  variable 
completely  determines  a  binary  random  variable  for  a  free-response  item  leads  to  the  two-parameter  normal  ogive 
submodel.  This  submodel  will  be  derived  and  discussed  in  Chapter  2.  The  manner  in  which  a  continuous  random 
variable  completely  determines  a  binary  random  variable  for  a  multiple-choice  item  leads  to  the  three-parameter 
normal  ogive  submodel.  This  submodel  will  be  derived  and  discussed  in  Chapter  3.  These  following  chapters 
will  provide  examples  of  continuous  random  variables  for  free-response  and  multiple-choice  items  where  the 
normal  ogive  submodels  are  given  separate  treatment. 

In  this  report,  standard  notation  will  be  observed.  Random  variables,  whether  continuous  or  discrete,  and 
random  vectors  will  be  denoted  by  capital  letters.  Lowercase  letters  will  denote  realizations  or  scores  on  the 
random  variables  and  random  vectors. 

Let  Zg  be  designated  as  the  continuous  random  variable  basic  to  the  binary  scoring  of  item  g.  Each 
realization  of  Zg,  £g,  is  a  score  that  is  assigned  to  a  particular  answer  to  item  g. 

The  location  of  a  particular  individual  i  on  the  score  continuum  representing  the  different  values  of  the 
random  variable  for  item  g  on  a  particular  occasion  o  is  symbolized  by  £gi(r  In  the  classical  test  theory  formulation 
of  Lord  and  Novick  (1968),  £gio  is  decomposed  into  a  true  score  component,  rgh  and  an  error  score  component, 


Cgio  Tgi  T  $gio*  (ELI) 

Following  Lord  and  Novick,  the  true  score  component  of  person  /’ s  score,  rgh  is  defined  as  the  expected  value 
of  £gio  over  repeated  administrations  of  item  g  to  individual  /  under  identical  testing  conditions 

V  =  (1.1.2) 

The  measurement  error  on  occasion  o  is  the  simple  difference, 

^ gio  ~  Cgio  ~  Tgj.  (LI. 3) 

which  is  in  mean  deviate  form  because  of  (1.1.2).  Some  statistically  desirable  consequences  of  these  particular 
true  score  and  error  score  definitions  are  proved  in  Lord  and  Novick  (1968,  pp.  29-50). 

The  fundamental  assumptions  that  characterize  the  model  are  (1)  that  the  true  score  components  of  each 
continuous  variable  determining  the  binary  scores  on  item  g  are  linear  transformations  of  a  common  underlying 
latent  trait  or  factor,  (2)  that  scores  on  this  latent  trait  are  normally  distributed  in  the  population  of  potential 
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examinees,  and  (3)  that  measurement  error  is  also  normally  distributed  in 
For  item  g ,  these  assumptions  are  expressed  formally  via 

the  population  of  potential  examinees. 

Tg  =  pg0. 

(1.1.4) 

e  ~  9),  ^(O)], 

(1.1.5) 

and 

4  ~  N[i*Ag),  o2( 4)], 

(1.1.6) 

where  Tg  and  Ag  are  the  true  score  and  error  variables  for  the  continuous  variable  basic  to  item  g,  O  is  the  latent 
trait  variable  with  mean  /x(0),  variance  a2(0),  and  /3g  is  the  weight  that  transforms  the  latent  trait  metric  into 
the  true  score  metric  for  the  continuous  variable  underlying  item  g.  Equation  (1.1.4)  asserts  that  true  score  on 
the  continuous  variable  determining  the  binary  scores  on  item  g  is  the  product  of  a  weight  and  the  score  on 
the  latent  trait  0\  while  equation  (1  1.5)  indicates  that  the  scores  on  the  latent  trait  0  are  distributed  normally 
with  a  mean  of  fi(0)  and  a  variance  of  cr{6).  Asserted  in  (1.1.6)  is  that  the  error  variable  associated  with  the 
continous  variable  which  determines  the  binary  scores  on  item  g  is  distributed  normally  with  a  mean  of  fx{Ag) 
and  a  variance  of  cZ(Ag).  A  set  of  equations  similar  to  (1.1.4)  and  (1.1.6)  exists  for  each  of  the  remaining 
p  -  1  items.  All  p  sets  of  equations  can  be  expressed  compactly  in  matrix  notation  as 

T=pe  (1.1.7) 

and 

(1.1.8) 

where  T  is  a  p- by-1  true  score  vector,  A  is  a  p-by-l  measurement  error  score  vector,  is  a  p- by-1  vector  of 
transformation  weights,  n(A)  is  a  p- by-1  vector  of  measurement  error  means,  and  X(A,A)  is  a  p-by-p  matrix  of 
measurement  error  variances  and  covariances.  Equation  (1. 1.7)  indicates  that  the  vector  of  true  scores  on  the 
continuous  variables  determining  the  binary  item  scores  is  the  product  of  the  vector  of  weights,  /2,  for  these 
continuous  variables  and  the  scores  on  the  latent  trait  O ;  while  (1.1.8)  asserts  that  the  error  score  vector  A  is 
distributed  multinormally  with  a  mean  vector  /jl(A),  and  a  variance-covariance  matrix  2(A,A). 

The  definitions  of  true  score  and  error  score  in  (1.1.1)  and  (1.1.2)  and  the  normality  and  linearity 
assumptions  in  (1.1.5),  (1.1.7),  and  (1.1.8)  yield  the  following  results: 

fJi(A)  =  0  (mean  error  score  on  every  item  is  zero);  (1-19) 

p(Q,Ag)  =  0  for  all  g,  (error  scores  and  latent  trait  scores  are  uncorrelated);  and  (1.1.10) 

p(AgiAh)  =  0  for  all  g  and  h  where  g±h,  (error  scores  on  different  items  are  uncorrelated).  (1.1.11) 

As  a  consequence  of  (1.1.11),  X(A,A)  is  a  diagonal  matrix.  The  linear  independencies  evident  in  (1.1.10)  and 
(1.1.11)  imply  stronger  statistical  independencies  under  the  stated  normality  assumptions. 

Since  linear  combinations  of  normally  distributed  variables  are  also  normally  distributed  (Anderson, 
1958),  it  follows  from 


z  =  p  e  +  a 


(1.1.12) 


that 


Z~  NlpfjL(G),  X(Z,Z)\.  (1.1.13) 

or,  in  words,  that  the  p- by-1  vector  Z  is  distributed  multinormally  with  a  mean  vector  provided  by  the  vector 
and  scalar  product  Pp(O)  and  with  a  variance-covariance  matrix  X(Z,Z).  This  matrix  contains  the  variances 
and  covariances  of  the  continuous  variables  Zg  that  determine  the  binary  item  scores. 
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The  p-by-p  variance-covariance  matrix  X(Z,Z)  can  be  decomposed  into 

2(Z,Z)  =  1 3/3'  or (6)  +  X(A,A).  (1.1.14) 

Equations  (1.1.12)  and  (1.1.14)  can  be  immediately  recognized  as  the  fundamental  equations  of  a  linear 
common  factor  model  with  a  single  common  factor,  0.  Since  X(A,A)  is  a  diagonal  matrix,  the  off-diagonal 
element  in  the  gth  row  and  /2th  column  of  X(Z,Z),  u(Zg,Zh),  is 

<XZg,Zh)  =  Pgh^O).  (1.1.15) 

Note  that  (1.1.12)  and  (1.1.14)  are  also  standard  equations  from  simple  linear  regression  where  the  Zg 
are  the  criteria,  0  is  the  predictor,  and  the  Ag  are  the  errors  of  prediction.  As  such  ft  is  a  p-by-1  vector  of  least 
squares  regression  weights, 

P-  [Diag  X(Z,Z)]  5p(Zg,d)[o(Q)]  - 1  (1.1.16) 

where  the  gth  diagonal  element  of  the  p-by-p  diagonal  matrix,  [Diag  X(Z,Z)\,  is  the  variance  of  Zg9  a2^), 

and  p(Zg,0)  is  a  p- by- 1  vector  of  correlations  between  the  Zg  and  0.  In  addition,  the  gth  diagonal  element  of 

X(A,A)  can  be  expressed  as 


cr{Ag)  =  cr(Zg)  [1  -  fr(Zg,0)].  (1.1.17) 

If  the  Zg  and  0  are  scaled  to  a  mean  of  zero  and  a  standard  deviation  of  unity,  (1.1.16)  and  (1.1.17) 
reduce  to  the  forms 

p  =  p(Zgi0)  (1.1.18) 

and 

criA^)  =  1  -  friZ^O ).  (1.1.19) 

Note  that  the  measurement  error  variance  in  (1.1.19)  is  also  the  conditional  variance  of  Zg  given  0 , 

^(4)  =  ^(2*  I  0).  (1.1.20) 

and  that  this  conditional  variance  is  the  same  at  all  levels  of  the  continuous  variable  O,  that  is  the  errors  of 
measurement  are  homoscedastic  as  a  consequence  of  the  normality  assumptions.  In  addition,  substitutions  from 
(1.1.18)  into  (1.1.15)  yield 


o{Zg,Zh)  =  p(Zg,Zh)  =  p(Zg,6)  p{Zh,0)  (1.1.21) 

because  of  the  unit  scalings  of  the  continuous  variables  ZH  and  O.  Equations  (1.1.18)  through  (1 . 1 .21)  can  be 
recognized  as  aspects  of  the  traditional  correlational  formulation  of  the  model  for  a  single  common  factor,  and 
can  also  be  viewed  as  characteristic  of  a  model  for  “congeneric”  items. 

Notice  that  specific  factors  for  items  are  not  defined  in  this  model.  As  a  result,  item-specific  factors 
would  be  included  in  the  measurement  error. 
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2.  EFFECTS  OF  BINARY  SCORING:  A  SUBMODEL 
FOR  FREE-RESPONSE  ITEMS 


2.1  The  Two-Parameter  Normal  Ogive  Submodel 

Suppose,  as  did  Samejima  (1969),  that  the  answers  to  a  free-response  (short  answer)  item  can  be  placed 
in  order  based  on  the  degree  of  attainment  of  a  proper  solution  to  the  problem  posed  by  the  item.  For  p  test 
items  designed  to  measure  the  same  ability,  such  an  ordering  would  generate  p  item  score  continua.  When  the 
scores  along  these  continua  are  associated  with  the  relative  frequencies  of  individuals  producing  each  particular 
answer,  continuous  random  variables  such  as  the  Zg  of  Chapter  1  would  be  the  result.  Now  suppose  that  a 
decision  is  made  to  separate  the  ordered  answers  on  each  of  the  p  item  continua  into  two  mutually  exclusive 
sets,  acceptable  (correct)  and  unacceptable  (incorrect).  This  separation  entails  the  dichotomization  of  the  p 
continua.  Let  yg  symbolize  the  point  of  dichotomization  along  the  continuum  Zg.  Dichotomization  of  Zg  is 
represented  formally  by  a  rescaling  of  the  continuous  variable  Zg  into  a  binary  variable  Ug.  By  convention, 
correct  answers  are  scored  one ,  while  incorrect  answers  are  scored  zero .  Hence  Ug  has  two  possible  realizations: 

ug  =  1  When  £g  >  yg  (correct  answer  produced) 

ug  =  0  When  £g  <  yg  (incorrect  answer  produced) 

Note  that  the  dichotomization  of  Zg  completely  determines  the  random  variable  Ug.  This  dichotomization 
also  produces  two  additional  random  variables.  Since  the  Zg  are  affected  by  measurement  error,  so  are  the  U 
The  transformation  of  Zg  into  Ug  thus  results  in  a  transformation  of  true  score  metric.  In  effect,  a  new  true  score 
variable  Tg  and  a  new  error  score  variable  Eg  are  produced  implicitly  by  the  Zg  into  Ug  transformation. 

For  individual  i  on  testing  occasion  o,  tgi  represents  the  individual’s  true  score  on  binary  item  g,  while 
egio  is  the  individual’s  error  score  on  binary  item  g.  Again,  true  score  is  defined  as  the  expected  value  of  the 
ugio,  which  are  realizations  of  Ug  for  individual  /,  over  testing  occasions  o,  that  is, 

tg!  =  Ugio  (2.1.1) 


while  error  score  is  defined  as 


^  gio  ^gio  tgi'  (2.1.1) 

Under  the  definition  of  true  score  presented  in  (2.1.1),  Tg  is  the  least  squares  estimate  of  Ug  given  0. 
All  individuals  of  ability  equal  to  that  of  individual  i,  6  -  0,,  have  identical  true  scores,  tg,  that  is 

tg  =  %  (U8\  6  =  0,)  (2.1.3) 

which  is  a  specific  realization  of  the  random  variable 

Tg  =  %  (Ug  |  0).  (2.1.4) 

The  expectation  relationship  in  (2.1.4)  defines  Tg  as  the  least  squares  regression  function  of  Ug  onto  0. 

At  this  point,  a  functional  form  for  the  regression  of  Ug  onto  0  must  be  determined.  Due  to  the  normality 
assumptions  stated  in  Chapter  1 ,  this  functional  form  is  the  item  characteristic  curve  for  the  two-parameter  normal 
ogive  of  latent  trait  theory  (Lord  &  Novick,  1968).  The  derivation  of  this  form  requires  some  elementary  calculus 
and  knowledge  of  statistical  expectations. 
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By  definition,  the  expected  value  of  a  discrete  random  variable,  such  as  Ug,  is  the  sum  of  the  products 
between  each  realization  of  Ug  and  its  relative  frequency.  The  expected  value  of  Ug  given  0  is, 


1 

T*  =  %  (Ug  I  0)  =  2  ugk  Pr(%  |  0)  =  (0)  Pr(«  =  0  |  6)  +  (1)  Pr(»  =  1  I  9) 

ugk  =  0  * 

=  Pr(«4,  =  1  |  0) 


(2.1.5) 


where  Pr (ug  -  0  |  0)  and  P r(ug  —  1  |  9)  are  the  probability  of  an  incorrect  answer  on  item  g  given  6  and  the 
probability  of  a  correct  answer  on  item  g  given  6  respectively.  Thus,  the  item  true  score  random  variable,  which 
is  the  least  squares  estimate  of  Ug  given  9,  is  equivalent  to  the  probability  of  a  correct  answer  on  item  g  given 
6.  Obtaining  an  expression  for  Pr (ug  =  1  |  9)  provides  us  with  the  functional  form  for  the  regression  of  U ,  onto 
9.  s 

Following  the  notation  used  by  Lord  and  Novick  (1968),  Pr(«*  =  1  |  6)  is  simply  the  item  characteristic 
curve  for  item  g,  Pg(9) 


Pr (ug  =  1  |  6)  =  Pg(9). 

From  the  definition  of  Ug  as  the  result  of  a  binary  rescaling  of  Zg,  it  is  known  that 


(2.1.6) 


Pg(9)  =  Pr (ug  =  1  |  9)  =  Pr(Z,  2*  y,  |  9).  (2.1.7) 

Therefore,  the  proportion  of  the  conditional  distribution  ofZs  that  is  above  the  point  of  dichotomization  y  equals 
the  true  score  for  \Jg  given  6.  The  regression  function  Tg  can  be  viewed  as  the  curve  that  connects  these  various 
conditional  proportions  that  can  be  computed  at  each  value  of  the  continuous  variable  6. 

Due  to  the  normality  assumptions  stated  in  Chapter  1,  the  conditional  distributions  of  Z  are  normal. 
Thus,  the  cumulative  normal  distribution  function  <£[*]  can  be  used  to  obtain  the  probability  of  a  correct  answer 
to  item  g  given  9.  To  use  the  cumulative  normal  distribution  function,  scores  on  the  conditional  distribution  of 
Zg  given  9  must  be  converted  to  a  mean  of  zero  and  a  variance  of  unity;  and  yg,  the  point  of  dichotomization 

on  Zg,  must  be  rendered  in  the  scale  of  the  standardized  conditional  distribution.  Let  1,(9)  represent  scores  that 
are  standardized  to  a  mean  of  zero  and  a  variance  of  unity;  and  let  y g(9)  represent  the  point  of  dichotomization 
on  the  Zg(6). 

For  a  given  value  of  O,  the  mean  of  Zg  is 


and  the  variance  of  Zg  is 


M(ZS  |  9 )  =  p(Z^G)0 


(2.1.8) 


criZg  |  9)  -  I  -  p2(Z^,G ).  (2.1.9) 

These  relationships  flow  from  the  normality  assumptions  of  Chapter  1  and  the  fact  that  the  unconditional 
distributions  of  both  O  and  Zg  have  been  scaled  to  a  mean  of  zero  and  a  variance  of  unity.  Equations  (2.1.8) 
and  (2.1.9)  enable  us  to  define  lg(6)  as 


}  (Q)  =  is - Zfjja  I  ^  _  4  p(Z,,0)9 

s  a(zg  1 9)  [i  -  p\Zg,e)}  y 


(2.1.10) 


The  relationships  in  (2.1.8)  and  (2.1.9)  also  enable  us  to  define  yg(9)  as 

y  <B)  =  *  ~  ^  I  ^  =  y*  ~  P(Z„0)9 

*  °iZg  |  0)  [1  -  p2(Zg,0)]  5 


(2.1.11) 
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where  simplification  of  the  expression  in  (2.1.11)  is  possible  by  introducing  and  defining  the  item  parameters 
agy  item  discriminatory  power,  and  bg,  item  difficulty,  as 


=  p(Zg,6>) 

'*  [1  -  p2(Zg,0)]-5 


(2.1.12) 


and 


p(Zg,0) 


(2.1.13) 


Given  (2.1.13),  an  explicit  solution  for  yg  is  provided  by 


yg  =  P(Zg,0)bg. 


(2.1.14) 


Substitutions  from  (2. 1  14)  and  then  (2. 1.12)  into  the  rightmost  equality  in  (2.1.1 1)  lead  to 

yg(6)  =  -  ag(0  -  bg)  (2.1.15) 


as  the  point  of  dichotomization  on  Zg(6). 

In  terms  of  Zg(6)  and  y g(0),  the  probability  of  a  correct  answer  to  item  g  given  0  can  be  expressed  as 


Pgiff)  =  Prj Zg(ff)  2*  yg(0)] 

=  (27 r)-'5  exp{-.5[4(0)]2}  d{g(6) 


(2.1.16) 


or,  equivalently,  due  to  symmetry  of  the  normal  distribution  function, 

P8(0)=  j_x  (27r)'-5exp{-.5[4(0)]2}J4(0).  (2.1.17) 

Given  (2.1.15),  it  is  to  be  noted  that 

Pg(0)  =  <P[-  ygm  =  <P[ag(0  -  bg)]  (2.1.18) 

where  <?[*]  is  by  definition  the  cumulative  normal  distribution  function  as  conventionally  expressed  in  (2.1.17) 
as  the  area  in  the  standard  normal  distribution  between  negative  infinity  and,  in  this  case,  negative  yg(6). 


The  Parameters 

In  (2.1.18),  one  has  an  expression  for  the  item  characteristic  curve,  the  item  true  score  function  Tg9  and 
the  regression  of  the  free-response,  binary  item  Ug  onto  latent  ability  6.  This  functional  form  gives  the  probability 
of  a  correct  answer  on  item  g  as  a  function  of  the  continuous  variable  O.  The  parameters  of  this  expression  are 
ag  and  bg ,  which  are  defined  in  (2. 1 . 12)  and  (2. 1.13). 

A  fuller  appreciation  of  these  item  parameters  is  acquired  through  examination  of  Figures  2.1.1  and  2.1.2. 
Latent  ability,  0,  is  portrayed  along  the  abscissa  in  both  figures.  Portrayed  along  the  ordinate  in  Figure  2.1.1 
is  the  dichotomized  continuous  variable  Zg.  The  point  of  dichotomization  on  Zg ,  yg9  is  located  on  the  ordinate. 
The  line  segment  extending  from  yg  across  the  figure,  parallel  to  the  abscissa,  divides  each  conditional  distribution 
of  Zg(6)  at  yg  into  two  mutually  exclusive  areas,  Pg(B)  and  Qg(d ),  which  represent  the  probabilities  of  correct 
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and  incorrect  answers  to  item  g,  given  6,  where  the  point  of  dichotomization,  y  has  been  rendered  in  the  scale 
of  Zg{0)  as  yg(0). 

The  line  traversing  the  figure  at  an  angle  of  less  than  45  degrees  with  the  abscissa  represents  the  linear 
regression  of  Zg  onto  0.  When,  as  in  this  case,  both  0  and  Zg  are  scaled  to  a  mean  of  zero  and  a  variance  of 
unity,  the  slope  of  this  linear  regression  is  p(Zg,0),  the  correlation  between  Zg  and  0. 

The  item  parameter  ag  is  defined  in  (2.1.12)  as  the  ratio  of  the  slope  of  the  regression  of  Z  onto  0  to 
the  standard  deviation  of  the  conditional  distributions  of  Zg,  which  is  the  same  at  all  levels  of  ©  due  to  the 
normality  assumptions  of  Chapter  1 .  It  may  be  observed  that  the  squaring  of  ag  yields  a  signal-to-noise  ratio  for 
the  linear  regression  of  Zg  onto  0, 


P2(Zr,0) 

1  -  P2(Zg,0)  ' 


(2.1.19) 


Notice  in  Figure  2.1.1  where  the  horizontal  line  extending  from  yg  intersects  the  line  of  regression  of 
slope  p(Zg>0).  The  projection  of  this  point  of  intersection  onto  the  latent  trait  continuum  defines  the  second 
parameter,  bg.  Since  the  conditional  distributions  of  Zg  are  symmetrical  around  the  line  of  regression  the  total 
area  of  the  conditional  probability  distribution  of  Zg  at  0  =  bg  is  halved  by  the  line  extending  from  y  ,  across 
the  figure.  Hence,  at  0  =  bg,  Pg(0)  =  Qg(0)  =  .5  where  Qg(0),  the  complement  of  Pg(0),  is  defined*  by 

CvgW 

Qg(0)  =  1  -  Pg{0)  =  J  ^  (27r)“  J  exp{-.5[4(0)]2}  dlg{0) 

=  &[yg(0)]  =  <P[-ag(0  -  bg)]  (2.1.20) 

which  yields  the  probability  of  an  incorrect  answer  to  item  g.  Again  <£[*]  is  by  definition  the  cumulative  normal 
distribution  function,  or  the  area  under  the  standard  normal  curve  between  negative  infinity  and  in  this  case 

yg(e). 


"*  =  1 


Figure  2.1.1.  Hypothetical  relations  among  the  item  continuum  Z  the  free-response,  binary  item  U  and  the 
latent  trait  Q . 
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Figure  2.1.2  represents  the  other  regression  of  interest  in  this  submodel,  the  nonlinear  regression  of  the 
binary  item  Ug  onto  the  continuous  latent  trait,  9.  From  (2.1.5)  through  (2.1.7)  it  is  known  that  the  regression 
of  Uv  onto  9  is  represented  by  Pv(6),  the  probability  of  a  correct  answer  to  item  g  given  0.  Hence  the  curve  of 
regression  in  Figure  2. 1 .2  may  be  obtained  by  computing  the  areas  of  the  conditional  distributions  of  Zg  given 
6  at  levels  of  9,  such  as  those  depicted  by  the  shaded  portions  in  Figure  2.1.1,  and  then  plotting  this  infinite 
number  of  areas  against  the  abscissa  to  obtain  Figure  2.1.2.  In  practice  integral  calculus  is  used  to  make  the 
transition  from  Figure  2.1.1  to  Figure  2.1.2. 

Example  2.1 .1 .  Item  g  as  depicted  in  Figure  2.1.1  can  be  used  for  the  purpose  of  numerical 
illustration.  The  slope  of  the  regression  of  ZK  onto  9,  %(ZK  \  9),  is  .90.  This  value  is  also  p(Zg,9) 
because  both  Zg  and  9  are  depicted  as  distributed  with  a  mean  of  zero  and  a  variance  of  unity. 

Thus  item  discriminatory  power,  aK,  as  given  by  (2. 1 . 12)  is  2.0647  In  Figure  2.1.1  the  ordinate 
and  abscissa  are  both  portrayed  for  the  range  of  values  from  -3.0  to  +3.0.  The  projection  of 
the  point  of  intersection  of  the  line  segment  extending  horizontally  through  yg  and  the  line  of 
regression,  %{Zg  \  9),  onto  the  abscissa,  occurs  at  a  value  of  -  .375.  Thus  bg  is  equal  to  —.375. 
Remember  the  conditional  distributions  of  Zg  given  9  are  symmetric  about  their  means,  which 
coincide  with  the  line  of  regression,  %(Zg  |  0);  and  by  definition,  at  0  =  bgt  P/b^),  the  probability 
of  a  correct  answer  to  item  g  is  .5,  as  indicated  in  Figure  2. 1.2. 

Example  2.1 .2.  In  Figures  2.1.1  and  2.1.2,  0'  has  the  value  of  -  1.50.  When  yt(0)  of 
(2. 1 .15)  is  evaluated  at  0',  it  is  found  that  y„(0')  equals  2.3228.  The  area  above  y„(0')  on  Zg(9'), 
the  standardized  conditional  distribution  of  Zg  given  0',  is  provided  by  (2.1.18)  as  .0101.  This 
value  of  PJd')  is  represented  by  the  size  of  the  shaded  area  in  the  standardized  conditional 
distribution  Z„(0')  as  depicted  in  Figure  2.1.1.  This  value  is  the  probability  of  a  correct  answer 
to  item  g  at  a  standard  ability  score  of  0'  or  -  1  50.  Hence,  a  point  has  been  placed  in  Figure 
2.1.2  with  the  coordinates  of  .0101  on  the  ordinate,  Pg(6),  and  0',  -  1.50,  on  the  abscissa. 


Figure  2.1.2.  The  item  characteristic  curve  or  the  regression  of  a  free- response,  binary  item  Ug  on  the  latent 
trait  9. 
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Example  2.1.3.  In  Figures  2.1.1  and  2.1.2,  6"  has  the  value  of  +.75.  When  yg(d)  of 
(2.1.15)  is  evaluated  at  6",  it  is  found  that  yg(ff')  equals  -2.3228.  The  area  above  yg(0")  on 
Zg(ff'),  the  standardized  conditional  distribution  of  Zg  given  d",  is  given  by  (2.1.18)  as  .9899. 

This  value  of  Pg(6")  is  represented  by  the  size  of  the  shaded  area  in  the  standardized  conditional 
distribution  Zg(6 ")  as  portrayed  in  Figure  2.1.1.  This  value  represents  the  probability  of  a  correct 
answer  to  item  g  at  a  standardized  score  of  6" or  +  .75.  Again,  a  point  has  been  placed  in  Figure 
2.1.2  with  the  coordinates  of  .9899  on  the  ordinate,  Pg(6),  and  0",  +.75,  on  the  abscissa. 

The  item  characteristic  curve  of  Figure  2.1.2  can  be  constructed  by  repeating  the  numerical  process 
illustrated  in  Examples  2.1.2  and  2.1.3  for  a  sufficient  number  of  points  equally  spaced  on  the  abscissa.  It  is 
often  helpful  to  be  able  to  inspect  the  item  characteristic  curves  for  various  items  given  their  parameters.  These 
item  characteristic  curves  can  be  conveniently  produced  for  this  purpose  through  the  use  of  a  plotter  and  the 
formulation  as  illustrated  for  the  arbitrary  points  d’  and  6"  for  a  free-response  item  g. 

Examination  of  Figure  2.1.2  provides  us  with  additional  information  about  the  latent  trait  item  parameters 
ag  and  bg.  In  mathematical  terms,  bg  is  the  value  on  the  latent  ability  continuum  corresponding  to  the  point  of 
inflection  on  the  item  characteristic  curve,  and  ag  is  proportional  to  the  slope  of  the  item  characteristic  curve  at 
its  point  of  inflection.  As  a  value  expressed  on  the  O  continuum,  bg  is  often  referred  to  as  the  item  location 
parameter.  Note  that  as  the  location  of  the  curve  shifts  to  the  right  along  the  6  continuum,  bg  increases,  requiring 
greater  ability  to  maintain  the  same  probability  of  successful  performance  on  the  item.  Hence,  bg  is  most  commonly 
known  as  the  item  difficulty  parameter. 

The  parameter  ag  indicates  how  well  the  item  discriminates  between  levels  of  ability  that  are  slightly 
above  and  below  6  =  bg.  As  ag  gets  larger,  the  slope  of  the  curve  becomes  steeper  and  the  discrimination 
between  ability  levels  close  to  bg  increases.  In  contrast,  flatter  curves  have  lower  values  of  ag,  reflecting  coarser 
measurement  over  a  broader  range  of  ability.  Thus  ag  is  most  commonly  known  as  the  parameter  of  item 
discriminatory  power.  For  other  discussion  of  these  two  parameters,  Lord  and  Novick  (1968)  and  Hambleton 
and  Cook  (1977)  can  be  consulted. 


2.2  Further  Consequences  of  the  Submodel 

Given  the  basic  model  from  which  the  two-parameter  normal  ogive  submodel  is  derived,  it  is  known  that 
the  joint  distribution  of  Zg  and  O  is  bivariate  normal.  This  condition  of  bivariate  normality  allows  the  derivation 
of  various  convenient  mathematical  expressions.  The  derivations  for  these  expressions  follow  from  defining 
relationships  within  the  bivariate  normal  distribution  In  this  section,  these  expressions  will  be  presented  and 
numerically  illustrated,  using  free-response  item  g  as  portrayed  in  Figure  2.1.1  for  illustrative  purposes.  These 
expressions  will  include  the  mathematical  formulation  for: 

1.  The  unconditional  probabilities  for  the  realizations  of  Ug. 

(a)  The  probability  of  a  correct  answer  to  item  g,  Pr (ug  =  1). 

(b)  The  probability  of  an  incorrect  answer  to  item  g,  Pr (ug  —  0). 

2.  The  conditional  means  of  Zg  given  the  realizations  of  Ug. 

(a)  The  mean  of  Zg  given  a  correct  answer  to  item  g,  ji(Zg  |  ug  =  1). 

(b)  The  mean  of  Zg  given  an  incorrect  answer  to  item  g,  fi(Zg  \  ug  =  0). 

3.  The  conditional  variances  of  Zg  given  the  realizations  of  Ug. 

(a)  The  variance  of  Zg  given  a  correct  answer  to  item  gt  cr(Z g  \  ug  =  1). 

(b)  The  variance  of  Zg  given  an  incorrect  answer  to  item  g,  cr{Zg  |  ug  =  0). 

4.  The  least  squares  estimators  of  ability  given  the  realizations  of  Ug. 

(a)  Specific  case. 

(1)  The  mean  of  6  given  a  correct  answer  to  item  g,  /jl(0  |  ug  =  1), 

(2)  The  mean  of  O  given  an  incorrect  answer  to  item  g,  fi(0\  ug  =  (J). 

(b)  General  case. 

(1)  The  mean  of  0*  given  a  correct  answer  to  item  g,  /x(0*  |  ug  =  1). 

(2)  The  mean  of  0*  given  an  incorrect  answer  to  item  g,  /x(0*  |  ug  -  0). 

These  expressions  will  be  derived  in  Section  2.3.  For  those  readers  seeking  a  general  understanding,  Section 

2.3  may  be  omitted  without  loss  of  continuity. 
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The  Unconditional  Probabilities  for  the  Realizations  of  Ug 

The  binary  random  variable  Ug  can  realize  one  of  two  possible  values.  In  the  case  of  a  correct  answer 
to  free-response  item  g,  ug,  the  realization  of  the  binary  random  variable  Ug,  equals  one\  or  the  realization  of 
Ug9  ug,  equals  zero  in  the  case  of  an  incorrect  answer  to  item  g. 

The  Probability  of  a  Correct  Answer  to  Item  g,  Pr(w^  =  1).  This  unconditional  probability,  most  com¬ 
monly  known  as  the  p- value  for  item  g,  is  designated  as  Pg.  A  convenient  expression  for  this  probability  is 

Pr (ug  =  1)  =  Pg  =  <P[~  yg\  (2.2.1) 

where  <P[  -  yg]  is,  by  definition,  the  cumulative  normal  distribution  function  evaluated  for  the  argument  which 
is  the  negative  of  yg,  the  point  of  dichotomization  on  the  continuous  variable  Zg.  This  point  of  dichotomization 
was  defined  in  (2.1.14)  as 


yg  =  p(Zg,9)bg .  (2.2.2) 

In  (2.2.2),  p(Zg,0)  is  the  correlation  between  the  continuous  variables  Zg  and  0,  and  bg  is  the  item  difficulty 
parameter. 


Example  2 .2.1 .  From  Example  2.1.1,  it  is  known  that  p(Zg70)  is  .90  and  that  bg  is  —  .375 
for  item  g  as  depicted  in  Figure  2. 1 . 1 .  It  is  found  through  the  use  of  (2.2.2)  that  yg  equals  -  .3375. 

When  P  of  (2.2.1)  is  evaluated  for  yg  equal  to  -  .3375,  it  is  known  that  <P[  -  yg],  the  cumulative 
normal  distribution  function  given  the  argument  -yg,  equals  .6321.  This  value  of  Pg  represents 
the  size  of  the  shaded  area  in  the  marginal  distribution  of  Zg  as  portrayed  along  the  ordinate  in 
Figure  2.1.1.  Notice  that  this  value  .6321  is  the  probability  that  £g  is  equal  to  or  greater  than  yg, 
or,  synonomously,  the  probability  of  the  realization  that  ug  equals  one . 

The  Probability  of  an  Incorrect  Answer  to  Item  g,  Pr (ug  =  0).  This  unconditional  probability  is  designated 
as  Qg.  A  convenient  expression  for  this  probability  is 

Pr  (ug  =  0)  =  Qg  =  <P[yg]  (2.2.3) 

where  <£[%]  is,  by  definition,  the  cumulative  normal  distribution  function  given  the  argument  yg9  and  yg,  the 
point  of  dichotomization  on  the  continuous  variable  Zg,  is  provided  by  (2.2.2). 

Example  2.2.2.  It  is  known  from  Example  2.2. 1  that  yg  is  -  .3375  for  item  g  as  presented 
in  Figure  2.1.1.  When  Qg  of  (2.2.3)  is  evaluated  given  yg  equal  to  -.3375,  it  is  found  that 
<P[yg],  the  cumulative  normal  distribution  function  given  the  argument  yg,  is  equal  to  .3679.  This 
value  of  Q ,  represents  the  size  of  the  unshaded  area  in  the  marginal  distribution  of  Zg  as  portrayed 
along  the  ordinate  in  Figure  2.1.1.  Notice  that  this  value  .3679  is  the  probability  that  £g  is  less 
than  yg  or,  synonomously,  the  probability  of  the  realization  that  ug  equals  zero. 

If  y  were  actually  the  cut  score  on  an  observed  continuous  variable  Zg,  then  Pg  would  be  the  selection 
ratio  or  the  probability  of  being  selected;  and  Qg  would  be  the  probability  of  being  rejected.  There  exists  then 
an  analogous  relationship  between  the  binary  scores  on  item  g,  either  a  one  or  a  zero ,  and  selection  or  rejection 
on  an  observed  continuous  variable. 


The  Conditional  Means  of  Z9  Given  the  Realizations  of  Ug 

The  mean  of  Z  ,  can  assume  only  one  of  two  possible  values.  In  the  case  of  a  correct  answer  to  free- 

response  item  g,  ng,  the  realization  of  the  binary  random  variable  Ug,  equals  one.  Thus  the  mean  of  Zg  given  a 

correct  answer  to  free-response  item  g  is  designated  /x  (Zg  |  ug  =  1).  In  the  case  of  an  incorrect  answer  to  free- 
response  item  g,  ug,  the  realization  of  the  binary  random  variable  Ug,  equals  zero.  Thus  the  mean  of  Zg  given 
an  incorrect  answer  to  free-response  item  g  is  designated  as  fx  (Zg  |  ug  =  0). 

The  Mean  of  Zg  Given  a  Correct  Answer  to  Item  g,  fx(Zg  |  ug  =  1).  A  convenient  expression  for  this 

mean  is  given  by 
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(2.2.4) 


In  (2.2.4),  4>(yg)  is  the  density  of  the  standard  normal  distribution  at  yg  or 

4>(yg)  =  '  5  exp(-  .5  y%) 


(2.2.5) 


where  yg,  the  point  of  dichotomization  on  the  continuous  variable  Z„,  is  provided  by  (2.2.2);  and  P  is  the 
unconditional  probability  of  a  correct  answer  to  item  g  as  given  by  (2.2.1). 

Example  2.2.3,  In  Example  2.2.1,  it  was  found  that  yg  equalled  -.3375  for  item  g  as 
depicted  in  Figure  2.1.1.  When  (2.2.5)  is  evaluated  for  yg  equal  to  -.3375,  it  is  known  that 
<K~  .3375),  the  density  of  the  standard  normal  distribution  evaluated  at  yg,  is  .3769.  In  Example 
2.2.1,  it  was  found  that  Pg  equalled  .6321.  Evaluating  (2.2.4)  with  these  values  for  <j>(yg)  and 
Pg,  it  is  known  that  the  mean  of  Zg  for  the  subpopulation  obtaining  a  correct  answer  on  this  item 
g,  p.(Zg  |  ug  =  1),  is  .5963.  Remember  that  the  range  of  the  continuous  variable  Z,  as  depicted 
in  Figure  2.1.1  is  from  —3.0  to  +3.0.  This  value,  .5963,  represents  the  mean  of  the  shaded 
portion  in  the  marginal  distribution  of  Zg.  The  reader  can  judge  the  accuracy  of  this  value  through 
visual  inspection  of  Figure  2.1.1. 

The  Mean  ofZg  Given  an  Incorrect  Answer  to  Item  g,  p.(Zg  |  ug  =  0).  A  convenient  expression  for  this 
mean  is  provided  by 


(2.2.6) 


where  <j>(yg),  the  density  in  the  standard  normal  distribution  evaluated  at  yg,  is  defined  in  (2.2.5)  and  Q  ,.  the 
unconditional  probability  of  an  incorrect  answer  to  item  g,  is  provided  by  (2.2.3). 

Example  2.2.4.  For  the  item  presented  in  Figure  2.1.1,  it  was  found  in  Example  2.2.3 
that  4>(yg)  equalled  .3769  and  in  Example  2.2.2  that  Qg  equalled  .3679.  When  (2.2.6)  is  evaluated 
for  these  values  for  <fr(yg)  and  Qg,  it  is  known  that  the  mean  of  Z?  for  the  subpopulation  obtaining 
an  incorrect  answer  on  this  item  g,  p.{Zg  |  ug  =  0),  is  -  1.0245.  This  value,  -  1.0245,  represents 
the  mean  of  Zg  for  the  unshaded  portion  in  the  marginal  distribution  of  Zg  as  portrayed  in  Figure 
2.1.1.  The  reader  can  judge  the  accuracy  of  this  value  through  visual  inspection  of  Figure  2. 1  1 
-  marginal  distribution  of  Zg  is  depicted  in  Figure  2.1.1  as  ranging  in  value  from  -3T)  to 

If  yg  were  actually  a  cut  score  on  an  observed  variable  Zg,  then  p.{Zg  \  ug  =  1)  would  be  the  mean  of 
Zg  for  the  subpopulation  explicitly  selected  on  this  variable.  Similarly,  p(Zg  j  ug  =  0)  would  be  the  mean  of 
Zg  for  the  subpopulation  explicitly  rejected  on  this  variable. 

The  Conditional  Variances  of  Zg  Given  the  Realizations  of  Ug 

The  variance  of  Zg  can  assume  only  one  of  two  possible  values.  For  a  correct  answer  to  free-response 
item  g,  the  realization  of  the  binary  random  variable  Ug,  ug,  is  one.  Hence,  the  variance  of  Z  given  a  correct 
answer  to  free-response  item  g  is  designated  o*(Z,  |  ug  =  1).  For  an  incorrect  answer  to  free-response  item  g, 
the  realization  of  the  binary  random  variable  Ug,ug,  is  zero.  Hence,  the  variance  of  Z  given  an  incorrect  answer 
to  free-response  item  g  is  designated  a2(Z?  |  u  =  0). 


The  Variance  ofZg  Given  a  Correct  Answer  to  Item  g,  ct{Zg  \  ug  =  1).  A  convenient  expression  for 


this  variance  is  given  by 


(2.2.7) 


where  yg,  the  point  of  dichotomization  on  the  continuous  variable  Zg,  is  provided  by  (2.2.2);  4>(y,.),  the  density 
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in  the  standard  normal  distribution  evaluated  at  yg,  is  provided  by  (2.2.5);  and  Pg,  the  unconditional  probability 
of  a  correct  answer  to  item  g,  is  given  by  (2.2  1). 


Example  2.2.5 .  It  is  known  from  Example  2.2.1  that  yg  equals  -.3375  and  Pg  equals 
.6321  for  item  g  as  presented  in  Figure  2.1.1.  It  is  further  known  from  Example  2.2.3  that  <f>(yg) 
equals  .3769.  When  (2.2.7)  is  evaluated  with  these  values,  it  is  found  that  the  variance  of  Zg 
given  a  correct  answer  to  this  item  g,  <rl(Zg  |  ug  =  1),  equals  .4432.  The  square  root  of  this 
value,  .6658,  thus  represents  the  standard  deviation  of  Zg  given  a  correct  answer  to  this  item  g, 
cr(Zg  |  uq  ~  1).  The  value  of  .6658  represents  the  standard  deviation  for  the  shaded  area  of  the 
marginal"  distribution  of  Zg  as  depicted  along  the  ordinate  in  Figure  2.1.1. 

The  Variance  ofZg  Given  an  Incorrect  Answer  to  Item  g}  o2(Zg  |  ug  =  0).  A  convenient  expression  for 
this  variance  is  provided  by 


a2(Zs  |  ug  =  0)  = 


e* 


.  e* 


(2.2.8) 


where  yg ,  the  point  of  dichotomization  on  the  continuous  variable  Zg ,  is  provided  by  (2.2.2);  (f)(yg ),  the  density 
in  the  standard  normal  distribution  evaluated  at  yg ,  is  yielded  by  (2.2.5);  and  Qg ,  the  unconditional  probability 
of  an  incorrect  answer  to  item  g ,  is  given  by  (2.2.3). 

Example  2.2.6.  For  item  g ,  as  depicted  in  Figure  2.1.1,  it  is  known  from  Example  2.2. 1 
that  yg  equals  —  .3375.  It  is  further  known  from  Example  2.2.2  that  Qg  equals  .3679  and  from 
Example  2.2.3  that  4>{yg)  equals  .3769.  When  (2.2.8)  is  evaluated  with  these  values,  it  is  found 
that  the  variance  of  Zg  given  an  incorrect  answer  to  item  g,  \  ug  =  0)  is  .2962.  Thus,  the 

square  root  of  this  value,  .5443,  represents  the  standard  deviation  of  Zg  given  an  incorrect  answer 
to  this  item  g,  u(Zg  \  u ?  =  0).  The  value  .5443  represents  the  standard  deviation  of  the  unshaded 
portion  of  the  marginal  distribution  of  Zg  as  portrayed  along  the  ordinate  in  Figure  2.1.1. 


The  Least  Squares  Estimators  of  Ability  Given  the  Realizations  of  Ug 


Here  two  cases  are  considered:  the  specific  case  where  ability,  0,  has  a  mean,  p.{0),  of  zero  and  a 
variance,  cr^ 0 ),  of  unity;  and  the  general  case  where  ability,  0 *,  has  a  mean,  and  a  variance,  a2(0*), 

that  may  be  prescribed  by  the  practitioner  for  convenience  in  applications. 

Specific  Case.  In  this  case,  the  estimators  of  ability,  0,  depend  on  the  realizations  of  the  random  binary 
variable  Ug  or  the  correctness  or  incorrectness  of  the  answer  to  free-response  item  g.  If  the  answer  is  correct, 
the  estimator  of  ability  is  the  mean  of  O  for  the  subpopulation  that  would  obtain  a  correct  answer  on  free- 
response  item  g.  If  the  answer  is  incorrect,  the  estimator  of  ability  is  the  mean  of  0  for  the  subpopulation  that 
would  obtain  an  incorrect  answer  on  free-response  item  g. 

Specific  Case:  The  Mean  of  0  Given  a  Correct  Answer  to  Item  g,  p,(0  |  ug  ~  1).  This  estimator  of 
ability  is  a  least  squares  estimator  because  this  mean  provides  that  value  of  0  about  which  the  sum  of  the  squared 
discrepancies  is  minimized  for  the  variable  of  ability  given  a  correct  answer  to  free-response  item  g.  A  convenient 
expression  for  this  estimator  of  ability  is  provided  by 

p(0  I  Ug  =  1)  =  p(Zg,0)  n(Zg  I  Ug  -  1)  =  P(Zg,0)  (2.2.9) 

*8 

where  p{Zg,0)  is  the  correlation  between  the  continuous  variables  Zg  and  0.  Notice  that  p(Zg,0)  is  known 
when  cig,  the  item  parameter  of  discriminatory  power,  is  known  through 


p(Zg,0) 


a i 


(1  +  al)-5’ 


(2.2.10) 


which  represents  the  explicit  solution  for  p(Zg,0)  as  derived  from  (2.1.12).  In  (2.2.9),  p.(Zg  \  ug  -  1),  the 
mean  of  Zg  given  a  correct  answer  to  item  g,  is  provided  by  (2.2.4);  yg,  the  point  of  dichotomization  on  the 
continuous  variable  Zg,  is  yielded  by  (2.2.2);  4>(yg),  the  density  in  the  standard  normal  distribution  evaluated 
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at  the  point  of  dichotomization,  yg>  is  given  by  (2.2.5);  and  Pg,  the  unconditional  probability  of  a  correct  answer 
to  item  g,  is  provided  by  (2.2.1). 

Example  2.2.7.  In  Example  2.1.1  it  was  found  for  item  g  as  portrayed  in  Figure  2.1.1 
that  the  parameter  of  discriminatory  power  for  this  item,  ag,  was  2.0647.  When  (2.2. 10)  is  evaluated 
given  this  value  for  ag,  it  is  found  that  p(Zg,0)  equals  .90,  which  was  the  value  obtained  earlier 
in  Example  2.1.1  through  inspection  of  Figure  2.1.1.  From  Example  2.2.3,  it  is  known  that  the 
mean  of  Zg  given  a  correct  answer  to  item  g,  p(Zg  \  ug  ~  1),  is  .5963.  Given  these  values  for 
p(Zg,  0)  and  pXZg  \  ug  =  1),  an  evaluation  of  (2.2.9)  yields  .5367  as  the  value  of  the  mean  of 
0  given  a  correct  answer  to  this  item  g.  The  value  .5367  represents  the  mean  of  the  distribution 
portrayed  in  Figure  2.2.1. 

The  distribution  in  this  figure  is  easily  constructed.  The  value  of  the  ordinate  in  this  distribution, 
f(6  |  ug  =  1),  at  a  particular  value  of  the  abscissa,  6 ,  given  a  correct  answer  to  item  g,  can  be  obtained  from 

f(0\ug  =  1)  =  Pg(6)  m  (2.2.11) 

for  the  range  of  values  of  0  from  negative  to  positive  infinity.  The  ordinate  is  the  product  of  Pg(6),  the  probability 
of  a  correct  answer  to  item  g ,  as  provided  by  (2  1. 18),  and  (f)(6),  the  density  function  for  the  assumed  distribution 
of  0  when  both  of  these  terms  have  been  evaluated  at  a  particular  value  of  0.  The  density  function  for  the 
standard  normal  distribution,  (f)(6),  is  defined  as 

(f>(6)  =  (2tt)~  5  exp(  —  .5  &).  (2.2.12) 

When  the  values  of  the  ordinate  as  obtained  from  (2.2  1 1)  have  been  plotted  with  respect  to  the  abscissa  for  the 
range  of  values  of  0(ug  =  1)  from  —3.0  to  +3.0,  the  curve  delineating  the  distribution  portrayed  in  Figure 
2.2. 1  is  the  result. 


Figure  2.2.1.  The  distribution  of  ability  given  ug  equal  to  one ,  0(ug  =  1),  or,  identically,  the  distribution  of 
0  resulting  from  incidental  selection  on  0  due  to  explicit  selection  on  the  continuous  variable  Zg 
where  yg  is  the  cut  score. 
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Both  (2.2. 1 1)  and  (2.2.12)  provide  values  of  the  ordinate  for  a  particular  distribution.  In  the  instance  of 
(2.2.11)  the  distribution  is  that  of  ability  given  a  correct  answer  to  item  g,f(9  |  ug  =  1);  and,  in  the  instance 
of  (2.2.12),  the  distribution  is  that  of  ability,  0,  as  originally  assumed.  While  (2  2.12)  is  the  density  function 
for  the  distribution  of  0,  (2.2.1 1)  is  not  the  density  function  for  the  distribution  of  0{ug  =  1).  By  definition, 
a  density  function  provides  values  of  the  ordinate  given  the  condition  that  the  area  under  the  curve  is  unity.  The 
area  under  the  curve  described  by  (2.2. 1 1)  is  known  from  integral  calculus  to  be  Pg,  the  unconditional  probability 
of  a  correct  answer  to  item  g.  The  density  function  for  the  distribution  of  0(ug  =  1),  </>(0  |  ug  =  1)  can  be 
obtained  from  (2.2. 1 1)  through 

<K0  \  ug  =  0  ~  — - —  (2.2.13) 

g 

by  dividing  the  outputs  of  (2.2.11)  by  the  value  of  P... 

It  has  been  observed  that  yg,  the  point  of  dichotomization  on  the  continuous  variable  Z„,  is  translated 
through  (2.1.11)  and  (2.1.15)  into  the  yg(6),  the  points  of  dichotomization  on  the  standardized  conditional 
distributions  of  Zg  given  9,  the  Zg{8).  Remember,  this  translation  allowed  the  use  of  the  cumulative  normal 
distribution  function,  <£[*],  of  (2.118),  to  obtain  Pg(6),  the  probability  of  a  correct  answer  to  item  g  given  9. 
Now  if  yg  were  actually  a  cut  score  on  an  observed  continuous  variable  Zg,  then  the  y  .(9)  would  be  the 
corresponding  cut  scores  on  the  standardized  conditional  distributions  of  Zg  given  9,  the  Zg(8).  Under  this 
interpretation,  Pg(9),  as  obtained  from  (2.1.18),  yields  the  probability  of  being  selected  given  the  continuous 
variable  6.  As  a  further  consequence  of  this  interpretation,  the  distribution  portrayed  in  Figure  2.2. 1  as  generated 
from  (2.2.11)  would  be  the  distribution  of  O  resulting  from  incidental  selection  on  the  continuous  variable  O 
due  to  explicit  selection  on  the  continuous  variable  Zg  where  the  cut  score  is  y  . 

Specific  Case:  The  Mean  of  0  Given  an  Incorrect  Answer  to  Item  g,  p(0  \  ug  =  0).  This  estimator  is 
a  least  squares  estimator  because  this  mean  provides  that  value  of  0  about  which  the  sum  of  squared  discrepancies 
is  minimized  for  the  variable  of  ability  given  an  incorrect  answer  to  free-response  item  g.  A  convenient  expression 
for  this  least  squares  estimator  is  provided  by 

p(0  |  ug  =  0)  =  p(Zg,0)  p.{Zg  |  ug  =  0)  =  ~p(Zg,0)  .  (2.2.14) 

In  (2.2.14),  p{Zg,0)  is  the  correlation  between  the  continuous  variables  Zg  and  0  which  can  be  obtained  from 
(2.2.10)  when  ag,  the  item  parameter  of  discriminatory  power,  is  known;  p.(Zg  \  ug  =  0)  is  the  mean  of  Zy 
given  an  incorrect  answer  to  item  g  as  provided  by  (2.2.6);  yg  is  the  point  of  dichotomization  on  the  continuous 
variable  Zg  as  defined  by  (2.2.2);  4>(yg)  is  the  density  in  the  standard  normal  distribution  evaluated  at  yg  as 
given  by  (2.2.5);  and  Qg,  the  unconditional  probability  of  an  incorrect  answer  to  item  g  is  provided  by  (2.2.3). 

Example  2.2.8.  In  Example  2.2.7,  it  was  found  for  item  g  as  depicted  in  Figure  2.1.1 
that  p(Zg,0),  the  correlation  between  the  continuous  variables  Zg  and  0,  was  .90;  and  in  Example 
2.2.4,  the  value  of  —  1 .0245  was  obtained  for  p(Zg  |  ug  =  0),  the  mean  of  Ze  given  an  incorrect 
answer  to  item  g.  When  these  values  are  used  in  an  evaluation  of  (2.2.14),  it  is  found  that  the 
mean  of  0  given  an  incorrect  answer  to  this  item  g  is  -  .9220.  This  value  represents  the  mean 
of  the  distribution  illustrated  in  Figure  2.2.2. 

The  distribution  in  this  figure  is  also  easily  constructed.  The  value  of  the  ordinate  in  this  distribution, 
f{9 1  ug  =  0),  at  a  particular  value  of  the  abscissa,  8.  given  an  incorrect  answer  to  item  g,  can  be  obtained  from 

f(8  |  ug  =  0)  =  Qg(8)<K8)  (2.2.15) 

for  the  range  of  values  of  0  from  negative  to  positive  infinity.  The  ordinate  is  the  product  of  Qg(8).  the  probability 
of  an  incorrect  answer  to  item  g,  and  4>(8),  the  density  function  for  the  assumed  distribution  of  0  when  both  of 
these  terms  have  been  evaluated  at  a  particular  value  of  0.  The  probability  of  an  incorrect  answer  to  item  g 
given  9,  Qg{8),  is  provided  by  (2. 1.20),  and  the  density  function  for  the  standard  normal  distribution  is  defined 
by  (2.2.12).  When  the  values  of  the  ordinate  as  obtained  from  (2.2.15)  have  been  plotted  with  respect  to  the 
abscissa  for  the  range  of  values  of  0  from  -3.0  to  +3.0,  the  result  is  the  curve  delineating  the  distribution 
presented  in  Figure  2.2.2. 
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-3.0 


0 


+  3.0 


Figure  2.2.2.  The  distribution  of  ability  given  ug  equal  to  zero,  0{ug  =  0),  or,  identically,  the  distribution  of 
0  resulting  from  incidental  rejection  on  0  due  to  explicit  rejection  on  the  continuous  variable  Zg 
where  yg  is  the  cut  score. 


When  divided  by  the  appropriate  value,  (2.2.15),  as  in  the  instance  of  (2.2.12),  becomes  the  density 
function  for  the  distribution  of  Q(ug  =  0)  where  the  area  under  the  curve  is  unity.  As  known  through  integral 
calculus,  the  appropriate  value  in  this  situation  is  Qg,  the  unconditional  probability  of  an  incorrect  answer  to 
item  g.  This  density  function,  </>(0  I  ug  =  0),  is  provided  by 

<K0  K  =  0)  =  —  -  “jj  —  0)  ,  (2.2.16) 

which  yields  the  ordinate  for  the  distribution  of  0(ug  =  0)  where  the  area  under  the  curve  is  unity. 

Earlier  it  was  noted  that  yg,  the  point  of  dichotomization  on  the  continuous  variable  Zg,  is  translated 
through  (2.1.11)  and  (2.1.15)  into  the  yg(9),  the  points  of  dichotomization  on  the  standardized  conditional 
distributions  of  Zg  given  0,  the  Zg(d).  Now  if  yg  is  again  considered  as  the  cut  score  on  an  observed  continuous 
variable  Zg,  then  again  the  yg{0)  become  the  corresponding  cut  scores  on  the  Zg(d).  Under  this  interpretation, 
Qg(9),  as  obtained  from  (2.1.20),  yields  the  probability  of  being  rejected  given  the  continuous  variable  Zg\  and 
the  distribution  depicted  in  Figure  2.2.2  as  generated  from  (2.2.15)  would  be  the  distribution  of  0  resulting 
from  incidental  rejection  on  the  continuous  variable  0  due  to  explicit  rejection  on  the  continuous  variable  Z 
where  the  cut  score  is  yg. 

General  Case.  In  the  general  case  of  least  squares  estimators  of  ability  the  practitioner  prescribes  the 
mean  and  variance  of  0*,  the  continuous  variable  of  ability.  This  prescription  may  be  made  in  order  to  produce 
ability  estimates  yielding  a  given  mean  and  variance.  A  certain  mean  and  variance  may  be  convenient  in  a 
particular  application.  How  this  prescription  is  made  and  how  it  is  used  is  illustrated  in  Chapter  8.  Under  the 
illustrated  practice,  the  mean  of  0*  and  the  mean  of  the  estimates  of  0*  will,  in  expectation,  be  equal.  However, 
the  variance  of  0*  and  the  variance  of  the  estimates  of  0*  will  differ.  This  difference  will  be  smaller  when  the 
ability  estimates  for  all  individuals  are  more  precise,  and  larger  when  the  ability  estimates  for  all  individuals  are 
less  precise.  Thus  one  must  hold  the  degree  of  precision  fixed  when  solving  for  the  variance  of  0*  that  will 
yield  the  desired  variance  for  the  estimates  of  0*.  In  Chapter  8,  the  solution  for  the  appropriate  variance  of  0* 
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given  the  desired  variance  for  the  estimates  of  0*  is  obtained  by  holding  the  degree  of  precision  constant.  In 
practice,  this  degree  of  precision  is  maintained  through  the  effective  use  of  termination  rules  as  described  in  that 
chapter 

The  parameters  agJ  item  discriminatory  power,  and  bg ,  item  difficulty,  were  defined  by  (2.1.12)  and 
(2.1.13).  These  parameters  apply  in  the  specific  case  when  the  continuous  variable  of  ability,  0,  has  a  mean, 
^t(0),  of  zero  and  a  variance,  cr2(0),  of  unity.  When,  as  in  the  general  case,  the  continuous  variable  of  ability, 
0*,  has  a  mean,  /x(0*),  and  a  variance,  cr2(0*),  prescribed  by  the  practitioner,  the  parameters  ag  of  (2.1.12) 
and  bg  of  (2. 1.13)  no  longer  apply.  These  parameters  need  to  be  transformed  to  obtain  the  corresponding  parameters 
a*  and  6*  that  are  appropriate  for  the  continuous  variable  0*. 

In  this  general  case,  flf,  item  discriminatory  power,  is  obtained  from  the  transformation 


a 


* 

8 


a 


a 


oiO*)  ’ 


(2.2.17) 


and  b* ,  item  difficulty,  is  obtained  from  the  transformation 

b*  =  bg  (7(0*)  +  /x(0*),  (2.2.18) 

after  /x(0*)  and  0^(0*)  have  been  prescribed  by  the  practitioner.  These  transformations  yield  identical  proba¬ 
bilities  of  a  correct  answer  to  item  g  for  each  value  of  0  and  its  corresponding  value  of  0*.  The  item  characteristic 
curve  remains  invariant  given  the  transformation  of  the  continuous  variable  0  into  the  continuous  variable  0*. 
Notice  that  the  transformations  in  (2.2.17)  and  (2.2.18)  are  reversible.  The  use  of 


ag  =  a*  (7(0*) 

and 

b  =  b*  -  /x(0*) 
*  (7(0*) 


(2.2.19) 


(2.2.20) 


will  return  the  item  parameters  ag  and  bg  that  are  appropriate  for  0  when  a*  9  b*y  /x(  0*),  and  ct(0*)  are 
known. 

When  a*  and  b*  are  known,  that  is,  after  /x( 0*)  and  a 2(0*)  have  been  prescribed,  the  correlation  between 
the  continuous  variables  Zg  and  0*  is  given  by 


P(Zg,  0) 


a*  cr(0*) 

{1  +  [a*  (7(0*)]2}-5  * 


(2.2.21) 


which  is  identically  the  correlation  between  the  continuous  variables  Zg  and  0.  The  scale  of  ability  has  no  effect 
on  the  correlation.  When  a*  and  b*  are  known,  that  is,  after  fi(0*)  and  0^(0*)  have  been  prescribed,  the  point 
of  dichotomization  on  the  continuous  variable  Zg9  yg,  is  provided  by 


=  b*  -  /x(0*) 

^  [(a*)  2  +  <x2(0*)]  5 


(2.2.22) 


which  is  also  invariant  with  respect  to  a  change  of  scale  in  ability. 

In  the  general  case  the  least  squares  estimators  of  ability  are  merely  the  means  of  0*  given  the  two  possible 
outcomes:  the  mean  of  0*  given  a  correct  answer  to  free-response  item  g ,  /x(0*  |  ug  =  1);  and  the  mean  of 
0*  given  an  incorrect  answer  to  free-response  item  g,  /jl( 0*  |  ug  =  0). 

General  Case:  The  Mean  of  0*  Given  a  Correct  Answer  to  Item  g ,  /u,(0*  |  ug  =  1)-  This  least  squares 
estimator  of  ability  is  conveniently  provided  by 

1^(0*  I  ug  =  1)  =  n(6*)  +  p(Zg,0 )  a(0*)  n(Zg  I  ug  =  1) 

=  /x(0*)  +  p(Zg,G )  (7(0*)  .  (2.2.23) 

In  (2.2.23),  /x(0*)  and  cr(0*)  are  the  prescribed  mean  and  standard  deviation  of  the  continuous  variable  0*; 
p{Zg90)  is  the  correlation  between  the  continuous  variables  Zg  and  0*  as  provided  by  (2.2.21);  pu(Zg  |  ug  =  1) 
is  the  mean  of  Zg  given  a  correct  answer  to  item  g  as  given  by  (2.2.4);  yg  is  the  point  of  dichotomization  on 
the  continuous  variable  Zg  as  provided  by  (2.2.22);  4>{yg)  is  the  density  evaluated  at  this  point  of  dichotomization 
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as  obtained  from  (2.2.5);  and  P  is  the  unconditional  probability  of  a  correct  answer  to  item  g  as  provided  by 
(2.2.1).  The  values  for  p(ZgtO),  p{Zg  \ug  =  1),  ygt  4>(yg),  and  Pg  remain  invariant  under  a  linear  transformation 
of  scale  on  the  continuous  variable  of  ability. 

Example  2.2.9.  In  the  illustration  that  will  be  provided  in  Chapter  8,  it  is  deemed  desirable 
to  obtain  ability  estimates  that  will  have  a  mean  of  100  and  a  standard  deviation  of  20.  If  the 
precision  of  these  estimates  is  constant  for  all  individuals  at  the  termination  of  testing  and  com¬ 
parable  to  that  achieved  with  a  test  reliability,  as  will  be  defined  and  described  in  Chapter  7,  of 
.90,  then  the  mean,  /x(0*),  must  be  prescribed  as  100  and  the  variance,  o^(0*),  must  be  prescribed 
as  444.4444.  The  standard  deviation,  <x(0*),  must  then  be  21.0819. 

In  Example  2.1.1,  it  was  found  that  ag  for  item  g  as  depicted  in  Figure  2.1.1  is  2.0647. 

When  a*  of  (2.2.17)  is  evaluated  given  the  values  of  2.0647  for  ag  and  21.0819  for  <x(0*),  <2* 
is  found  to  be  .09794.  When  p(Zg,  0)  of  (2.2.21)  is  evaluated  with  these  values  of  <2*  and  cr(0*), 
p(Zg90)  is  found  to  be  .90  (the  identical  value  that  was  obtained  for  p(Zg,G)  through  the  use  of 
(2.2.10)  in  Example  2.2.7).  Evaluating  b*  of  (2.2.18)  given  the  values  -  .375,  as  obtained  from 
Example  2.1.1,  for  bg,  100  and  21.0819  as  prescribed  for  /x(0*)  and  cr(0*),  respectively,  b*  is 
found  to  be  92.0943.  In  obtaining  yg  from  (2.2.22)  given  the  values  of  .09794  for  a*,  92.0943 
for  £*,  100  for  /x(0*),  and  444.4444  for  cr2(0*),  yg  is  found  to  be  —  .3375  (the  identical  value 
that  was  obtained  for  yg  through  the  use  of  (2.2.2)  in  Example  2.2. 1).  Since  yg  is  -  .3375,  <t>(yg) 
and  Pg  have  already  been  determined.  Given  this  value  for  yg,  4>(yg)  was  found  to  be  .3769  in 
Example  2.2.3;  and  Pg  was  found  to  be  .6321  in  Example  2.2.1.  Since  cf>(yg)  and  Pg  are  both 
invariant  under  a  linear  transformation  of  the  scale  of  the  continuous  variable  of  ability, 
p(Zg  |  ug  —  1)  as  determined  by  (2.2.4)  must  also  be.  The  mean  of  Zg  given  a  correct  answer 
to  item  g,  \  ug  =  0*  was  found  to  be  .5963  in  Example  2.2.3. 

The  least  squares  estimator  of  ability,  pi(Q*  \  ug  =  1),  can  now  be  evaluated  through  the 
use  of  (2.2.23).  In  this  situation  for  this  item  g,  it  is  known  that  ^t(0*)  is  100,  p(Zg10)  is  .90, 

<r(0*)  is  21.0819,  and  fi{Zg  \  ug  =  1),  4>{yg)  divided  by  Pgi  is  .5963.  When  ^i(0*  |  ug  =  1) 
of  (2.2.23)  is  evaluated  given  these  values,  /x,(0*  |  ug  =  1)  is  found  to  be  11 1.3140.  The  value 
1 1 1.3140  represents  the  mean  of  the  distribution  depicted  in  Figure  2.2  1  after  a  linear  transfor¬ 
mation  of  0  into  0*.  This  transformation  can  be  effected  pictorially  by  merely  changing  the 
values  along  the  abscissa  in  Figure  2.2.1  from  —3.0  to  36.7543,  from  0  to  100,  and  from  +3.0 
to  163.2457.  With  this  transformation  of  the  scale  of  ability,  the  distribution  of  0*  given  ug  equal 
to  one ,  0*(ug  =  1),  is  analogous  to  the  distribution  of  ability  after  incidental  selection  on  0* 
resulting  from  explicit  selection  on  the  continuous  variable  Zg  where  yg  is  the  cut  score  on  the 
continuous  variable  ZK. 

In  the  psychological  literature  on  personnel  selection,  an  early  occurrence  of  a  mathematical  expression 
closely  related  to  that  in  (2.2.23)  was  due  to  Brogden  (1949).  In  this  article,  the  continuous  variable  comparable 
to  0*  is  a  criterion  measure  of  productivity,  Y ,  rendered  in  a  dollar  metric  with  a  standard  deviation,  crfE);  and 
the  predictor  of  this  criterion  measure  is  a  a  continuous  variable  Z  with  a  cut  score  y,  and  a  selection  ratio  P. 
The  validity  coefficient,  p(Z,  Y),  is  the  correlation  between  the  predictor,  Z,  and  the  criterion  measure,  Y.  Hence, 
the  mean  of  Y  given  explicit  selection  on  Z,  /x(K  |  selection  on  Z),  is 

fx(Y  |  selection  on  Z)  =  fi(Y)  +  p(Z,Y)  cr(Y)  ,  (2.2.24) 

which  is  merely  (2.2.23)  interpreted  into  the  context  of  personnel  selection.  The  output  of  (2.2.24)  is  also  the 
dollar  productivity  per  individual  selected  because  of  the  nature  of  the  criterion  variable  Y.  The  unconditional 
mean  on  the  criterion  variable,  pciY),  is  identically  the  mean  of  the  continuous  variable  Y  or  the  dollar  productivity 
per  individual  under  random  selection.  Hence,  the  gain  in  dollar  productivity  per  individual  selected  over  the 
situation  where  selection  is  at  random,  Ap,(Y  |  selection  on  Z),  is  given  by 

Ajjl(Y  |  selection  on  Z)  =  p(Z,Y)  a(Y)  ,  (2.2.25) 

into  which  the  cost  of  testing  can  be  incorporated.  The  cost  of  testing  is  given  by  the  cost  per  individual  examinee, 
C  (a  constant),  divided  by  P,  the  selection  ratio.  Thus,  the  gain  in  dollar  productivity  per  individual  selected 
adjusted  for  the  cost  of  testing,  Ap(Y  |  selection  on  Z,  cost  of  testing)  is 
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(2.2.26) 


Ap(Y  |  selection  on  Z,  cost  of  testing)  =  p(Z,Y )  a{Y)  ^  _ 

% 

because  random  selection  does  not  entail  a  cost  for  testing. 

The  utility  of  selection  on  the  continuous  variable  Z  adjusted  for  the  cost  of  testing,  (/(selection  on  Z, 
cost  of  testing),  is  defined  as  the  gain  in  the  dollar  value  of  productivity  adjusted  for  the  cost  of  testing  given 
those  individuals  selected  on  the  continuous  variable  Z.  This  utility  is  expressed  as  the  number  of  those  individuals 
selected  on  the  continuous  variable  Z,  //(selection  on  Z),  multiplied  by  the  output  of  (2.2.26),  the  gain  per 
individual  in  the  dollar  value  of  productivity  adjusted  for  the  cost  of  testing.  The  number  of  individuals  selected 
on  the  continuous  variable  Z,  ^selection  on  Z),  is  obtained  from 

//(selection  on  Z)  =  PN,  (2.2.27) 

where  P  is  the  selection  ratio  and  (V  is  the  total  number  of  individuals  tested.  Thus,  the  expression 
(/(selection  on  Z,  cost  of  testing) 

=  //(selection  on  Z)  Ap.(Y  |  selection  on  Z,  cost  of  testing)  (2.2.28) 

yields  the  gain  in  the  dollar  value  of  productivity  adjusted  for  the  cost  of  testing  given  those  individuals  selected 
on  the  predictor,  the  continuous  variable  Z,  where  y  is  the  cut  score  and,  thus,  P  is  the  selection  ratio. 

Genera!  Case:  The  Mean  of  O*  Given  an  Incorrect  Answer  to  Item  g,  pi 0*  |  ug  =  0).  This  least  squares 
estimator  of  ability  is  conveniently  provided  by 

P(0*  |  ug  =  0)  =  p(0*)  +  p{Zg,0)  cr(0*)  p(Zg  |  ug  =  0) 

=  p(0*)  -  p(Zg,6)  a(0*)  .  (2.2.29) 

In  (2.2.29),  p(0*)  and  a{0*)  are  the  prescribed  mean  and  standard  deviation  of  the  continuous  variable  0*; 
p(Zg>G)  is  the  correlation  between  the  continuous  variables  Zg  and  0*  as  given  by  (2.2.21);  p(Zg  \  i t„  =  0)  is 
the  mean  of  Zg  given  an  incorrect  answer  to  item  g  as  provided  by  (2.2.6);  yg  is  the  point  of  dichotomization 
on  the  continuous  variable  Zg  as  given  by  (2.2.22);  <S>(yf)  is  the  density  evaluated  at  this  point  of  dichotomization 
as  obtained  from  (2.2.5);  and  Qg  is  the  unconditional  probability  of  an  incorrect  answer  to  item  g  as  provided 
by  (2.2.3).  The  values  for  p{Zg,0),  p(Zg  \  ug  =  0),  yg,  d>(yg),  and  Pg  remain  invariant  under  a  linear 
transformation  of  the  scale  of  the  continuous  variable  of  ability. 

Example  2.2.10.  As  in  the  case  of  Example  2.2.9,  it  is  viewed  as  desirable  to  obtain 
ability  estimates  that  at  the  termination  of  testing  will  have  a  mean  of  100  and  a  standard  deviation 
of  20.  These  respective  values  can  be  obtained  by  terminating  the  tests  for  all  individuals  at  a 
level  of  precision  comparable  to  that  achieved  with  a  tailored  test  reliability  of  .90  and  prescribing 
the  mean  of  0*,  p{0*),  as  100  and  the  variance  of  0*,  cr2(0*),  as  444.4444  or  the  standard 
deviation  of  0*,  cr(0*),  as  21.0819. 

In  Example  2.2.9,  p(Zg,0),  yg>  and  4>(yg)  were  found  to  be  .90,  -.3375,  and  .3769, 
respectively,  for  item  g  as  depicted  in  Figure  2.1.1.  Since  yg  is  invariant  under  a  linear  transfor¬ 
mation  of  scale  of  the  continuous  variable  of  ability,  so  must  Qg  as  determined  by  (2.2.3)  be 
invariant.  The  unconditional  probability  of  an  incorrect  answer  to  item  g,  Qg,  was  found  to  be 
.3679  in  Example  2.2.2.  The  mean  of  Zg  given  an  incorrect  answer  to  item  g  is  also  invariant 
under  a  linear  transformation  of  scale  of  the  continuous  variable  of  ability.  This  invariance  nec¬ 
essarily  follows  since  4>{yg)  and  Qg  in  (2.2.6)  are  invariant  under  such  a  transformation.  In  Example 
2.2.4,  p(Zg  |  ug  =  0)  was  determined  to  be  —  1.0245. 

The  least  squares  estimator,  p(6*  \  ug  =  0),  can  now  be  evaluated  through  the  use  of 
(2.2.29).  For  this  situation  and  for  this  item  g,  it  is  known  that  p(6*)  is  100,  p{Zg,Q)  is  .90, 
ct<0*)  is  21.0819,  and  p(Zg  |  ug  =  0),  the  negative  of  <j>{yg)  divided  by  Qg,  is  -  1.0245.  When 
/a(0*  |  Ug  =  0)  of  (2.2.29)  is  evaluated  given  these  values,  p.(Q*  |  ug  =  0)  is  found  to  be 
80.5614.  The  value  80.5614  represents  the  mean  of  the  distribution  depicted  in  Figure  2.2.2  after 
a  transformation  of  0  into  0*.  This  transformation  can  be  effected  pictorially  by  merely  changing 
the  values  along  the  abscissa  in  Figure  2.2.2  from  -3.0  to  36.7543,  from  0  to  100,  and  from 
+  3.0  to  163.2457.  The  distribution  of  O*  given  an  incorrect  answer  to  item  g,  0*(ug  =  0),  is 
analogous  to  the  distribution  of  0*  after  incidental  rejection  on  0*  resulting  from  explicit  rejection 
on  the  continuous  variable  Zg  where  yg  is  the  cut  score  on  the  continuous  variable  Zg. 
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In  tailored  testing,  the  general  case  of  ability  estimation  is  the  more  interesting  case.  As  will  be  seen  in 
later  chapters,  this  case  allows  the  sequential  updating  of  ability  estimates  as  more  items  are  added  to  a  tailored 
test.  The  mean  and  variance  of  the  distribution  of  ability  change  as  each  answer  to  a  tailored  test  is  scored;  and 
it  is  the  general  case  that  produces  estimators  of  ability  under  these  changes.  The  specific  case  is  only  appropriate 
for  a  tailored  test  consisting  of  a  single  item.  This  case  cannot  accomodate  the  changes  in  the  mean  and  variance 
of  the  distribution  of  ability  that  occur  with  the  sequential  scoring  of  items  in  a  tailored  test. 

2.3.  Mathematical  Proofs 

The  convenient  expressions  that  are  derived  in  this  section  were  presented  and  numerically  illustrated 
earlier  in  Section  2.2.  The  mathematical  proofs  for  these  expressions  as  contained  in  this  section  may  be  omitted 
by  the  reader  who  is  seeking  a  general  understanding.  The  omission  of  this  section  will  not  result  in  a  loss  of 
continuity. 

At  this  juncture,  a  brief  review  of  the  bivariate  normal  distribution  is  in  order.  A  helpful  background  for 
this  review  can  be  found  in  Mood  and  Graybill  (1963),  It  will  be  shown  that  the  joint  distribution  of  the  continuous 
variables  Zg  and  0  is  bivariate  normal.  This  relationship  will  be  established  from  the  fundamental  assumptions 
of  the  basic  model  for  a  single  common  factor  presented  in  Chapter  1 .  Bivariate  normality  facilitates  the  derivation 
of  many  useful  mathematical  forms. 

Bivariate  Normal  Distribution 


In  the  present  instance,  the  joint  density  function  for  the  bivariate  normal  distribution  is  given  by 


<HL,0)  =  (277)-'  [1  -p2(Zg,0)}  5  exp  -.5 


g  -  2p(Zg,6>)  £ge  +  (P 
1  -  ?(Zk,6) 


(2.3.1) 


where  a  density  function  is  by  definition  a  relative  frequency.  In  the  case  of  a  joint  density  function,  as  in 
(2.3.1),  its  integral  over  the  plane  must  be  unity, 


dL  de  =  1 


(2.3.2) 


This  equality  may  be  proved  by  completing  the  square  on  £g  in  the  exponent  of  (2.3.1),  which  yields 

<KCg,0) 

=  (2v)~]  [1  -  p2(Z  G)]~s  exp 


,1  -  p2(Zg,0) 

After  rearranging  the  exponent  in  (2.3.3),  it  is  found  that 

<t>(£g,0)  =  (27 r)  '■  [1  -  p2(Zg, 0)]~  5  expl  -.5 


[4  -  p(Z,,6>)0]2  +  [1  -  p2(Z„,0)]d2  .  (2.3.3) 


4  -  p(Z„e)fl 

[1  -  pr(Z  G)]‘ 


-•502  , 


(2.3.4) 


which  when  integrated  over  the  plane  may  be  represented  as. 


u: 


(27 r)  1  [1  -  p2(Z  G)]  5  exp  -.5 


4  -  p(Zg,0)  0 

[i  -  p*(Z..e)]-s 


~.5d2  \dLd6.  (2.3.5) 


It  is  to  be  noted  that  4 (0)  of  (2.1.10)  can  now  be  substituted  into  the  exponent  of  (2.3.5).  Further,  since  the 
derivative  of  £g(6)  with  respect  to  4  is 

4  -  p(Zg,6>)0 
due)  [1  -  P2(Z?,6>)]-5 


dL 


=  [1  -  p2(Z„,6>)]"-5 


(2.3.6) 


it  is  known  that  the  differential  of  UQ )  in  relation  to  that  of  L  is 


d£g(6)  =  dCg  [1  -  p2(Zg,6)r 


(2.3.7) 
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(2.3.8) 


which  can  also  be  substituted  into  (2.3.5).  These  substitutions  allow  one  to  write  the  integral  as 

L  j_x  (27r)”'5  e*p{-.5  [^(fl)]2}  d£g(6)  (2w)~-5  exp(-.5 62)  dO, 

which  can  be  expressed  as  the  product  of  two  integrals 

(2tt)--5  exp{  —  .5  [4(0)]2}  dig{6)  f  _  (2ir)  '-5  exp(-.502)  dd  (2.3.9) 

because  it  is  known  that  the  innermost  integral  in  (2.3.8)  is  a  constant  during  integration  with  respect  to  0.  This 
integral,  now  on  the  left  side  of  (2.3.9),  is  the  cumulative  normal  distribution  function  of  (2.1.18)  In  this  case, 
it  represents  the  entire  area  under  the  normal  curve,  which  is  known  from  previous  discussion  to  be  unity.  The 
integral  on  the  right  side  of  (2.3.9)  is  also  a  cumulative  normal  distribution  function,  in  this  case,  that  for  the 
continuous  variable  O.  Because  0  is  assumed  to  be  normally  distributed  with  a  mean  of  zero  and  a  variance  of 
unity,  this  integral  is  also  known  to  be  unity.  Because  the  product  of  the  integrals  is  unity,  (2.3.2)  has  been 
proved. 

The  density  of  the  unconditional  or  marginal  distribution  of  0  is  by  definition 

m  =  J_x  <KCg,0)  dCg,  (2.3.10) 


where  a  substitution  from  (2.3.4)  yields 

W)  =  f_x  (2 ^r1  n  -  p2(zg,0))~ 5 exp(--s{jp_  p'fzfon]  ~-502)  d(‘-  (2-3-n) 

Again  it  is  noted  that  £g(d)  of  (2. 1  10)  can  be  substituted  for  the  expression  in  braces  in  the  exponent.  To  obtain 
the  integral  with  respect  to  £g(6),  a  substitution  from  (2.3.7)  is  also  necessary.  These  substitutions  lead  to 

<K0)  =  (27r)~  5  exp(— .5A2)  J  ^  (2ir)~  5  exp{-.5  [£g(0)]2}  d£g(6),  (2.3.12) 


where  it  is  known  from  previous  discussion  that  the  value  of  the  integral  is  unity  because  the  integral  represents 
the  cumulative  normal  distribution  function  for  the  total  area  under  a  normal  curve.  Thus  the  marginal  density 
of  0  is 


(f)(9)  =  (27 r)  5  exp(- .502), 

or  merely  the  density  of  the  univariate  normal  distribution. 

Notice  that  (2.3.4)  after  a  substitution  from  (2. 1.10)  may  be  written  as 

4>(£g,9)  =  [1  “  p2(Zg,0)]  5  (27T-)--5  exp{-.5[4(0)]2}  (27r)~-5  exp(-.502), 


(2.3.13) 


(2.3.14) 


the  triple  product  of  a  scalar  and  two  univariate  normal  densities.  This  scalar  maintains  a  probability  volume  of 
unity  under  the  normal  bivariate  surface  when  the  conditional  distributions  decrease  in  effective  range  about 
either  line  of  regression  as  the  correlation,  p(Zg,0),  transits  in  values  from  zero  to  unity.  One  of  the  densities, 
as  can  be  seen  from  (1.1.3)  and  (1.1.6),  represents  the  normal  probability  density  for  the  homoscedastic  error 
variable  Ag  while  the  other  represents  the  univariate  normal  density  for  the  continuous  variable  0.  Notice  that 
£g(0)  of  (2.1  10)  is  merely  Ag  converted  to  a  variance  of  unity.  The  means  of  the  Ag  are  already  zero,  as  can 
be  seen  in  (1.1.9).  The  fundamental  assumptions  of  the  model  for  a  single  common  factor  characterize  the  joint 
distribution  of  each  Zg  and  0  as  bivariate  normal.  If  the  regression  of  one  random  variable  on  another  random 
variable  is  linear,  and  the  marginal  distribution  of  that  random  variable  is  defined  as  univariate  normal,  and  the 
conditional  distributions  for  fixed  values  of  that  variable  are  homoscedastic  and  univariate  normal,  then  the  joint 
distribution  is  necessarily  bivariate  normal.  This  relationship  also  means  that  the  other  marginal  distribution  is 
univariate  normal  and  that  the  other  conditional  distributions  for  fixed  values  of  the  other  marginal  random 
variable  are  also  homoscedastic  and  univariate  normal. 

The  standardized  distributions  of  Zg  given  0,  the  Zg(6 ),  have  been  discussed  in  considerable  detail  with 
respect  to  their  relationship  to  the  item  characteristic  curve  of  the  two-parameter  normal  ogive  submodel. 
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Illustrations  were  provided  in  Figures  2.1.1  and  2.12.  The  exposition  will  now  turn  to  the  conditional  distributions 
of  0  for  fixed  values  of  Zg  and  the  unconditional  or  marginal  distribution  of  Z g.  This  exposition  will  require 
some  detail  because  of  the  special  relationship  between  Zg  and  the  binary  variable  Ux. 

Discussion  is  facilitated  by  completing  the  square  on  9  in  the  exponent  of  (2.3.1).  This  operation  yields 

<K£t,0) 

=  (277)-'  [1  -  p2(Zg,0)]~-5  exp(-_  ~(^  0)  j[0  -  p(Zg,0)  g2  +  [1  -  p2(Zg,0)]  (2.3.15) 


Equation  (2.3.15)  may  be  rearranged  in  the  exponent  as 

<H^e)  =  (277)-'  [1  -  p2(Zg,0)]~s  exp^  —  .5  ~  ^’^sl  --5  ?)) ,  (2.3.16) 

which  when  integrated  over  the  plane  may  be  represented  as 

r  r  -  i  r  o  -  p(Zg,0)  4  )2\ 

J_»  J_o=(2l7)" 5  [1  "  p(Z*’0)]  5 expV~-5([r-  p2(zs,e)]-5j  /  ^(2^)_-5exp(-.5  Q)dit. 

(2.3.17) 


Let  0(£g)  be  defined  as 


e  -  p{zK,e)  4 

[1  -  p2(Zg,0)l5  ’ 


(2.3.18) 


where  the  similarity  between  ^(6)  of  (2.1.10)  and  d(Q  of  (2.3.18)  is  apparent.  Both  expressions  represent 
standardized  scores  from  normal  conditional  distributions.  In  the  case  of  (2.3.18),  the  conditional  distributions 
are  those  of  0  given  It  may  be  noted  that  the  derivative  of  0(g  with  respect  to  6  is 


d6(£x) 

d6 


d  e  -  P(Zg,0)  cK 
[1  -  pz(Zg,0)]-5 


de 


=  [1  -  p2(Zg,0)\ 


(2.3.19) 


Therefore,  the  differential  of  0(£g)  in  relation  to  that  of  9  is  given  by 

dh(g)  =  del  1  -  P2(Zg,0)]~  5.  (2.3.20) 

Substitutions  from  (2.3.18)  and  (2.3.20)  into  (2.3.17)  now  allow  one  to  write 

(277)-  5  exp{-.5[6/(4)]2}  dO(Q  j  (2  77)  ~-5  exp(  -  .5  g)  d(g,  (2.3.21) 

the  product  of  two  integrals  both  known  to  have  a  value  of  unity.  Thus,  the  integral  over  the  plane  or  the 
probability  volume  under  the  bivariate  surface  as  given  in  (2.3.2)  can  also  be  verified  as  unity  from  this  perspective. 
The  density  of  the  unconditional  or  marginal  distribution  of  Zg  is  by  definition 

4>(Q  =  J  x  </>(£g,0)  de,  (2.3.22) 

where  a  substitution  from  (2.3.16)  permits  one  to  write 

=  f_x  (277)-'  [1  -  p2(Zg,0)] -  5  exp^ - -5 jjj-~  -.5  gj  d9.  (2.3.23) 

Substitutions  from  (2.3.18)  and  (2.3.20)  into  (2.3.23)  lead  to 

=  (2tt )--5  exp(  —  .5  (T2)  J_x  (277)"  5  exp{- ,5[0(g]2}  d0(£g),  (2.3.24) 
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where  the  value  of  the  integral  is  unity.  As  a  result,  it  is  found  that 

<K£g)  =  (27r)--5exp(-.5^)s  (2.3.25) 

indicating  that  the  unconditional  or  marginal  density  of  the  continuous  variable  Zg  is  merely  the  density  of  the 
univariate  normal  distribution. 

Given  the  developments  from  (2.3.3)  to  (2.3.9)  and  from  (2.3.15)  to  (2.3.21),  it  is  apparent  that  the 
bivariate  normal  distribution  can  be  portrayed  as  comprised  of  infinitely  many  conditional  distributions  of  Zg 
given  the  random  variable  0  as  well  as  comprised  of  infinitely  many  conditional  distributions  of  O  given  the 
random  variable  Zg.  The  former  portrayal  was  presented  in  abbreviated  fashion  in  Figure  2.1.1,  while  the  latter 
is  presented  in  an  analogous  fashion  in  Figure  2.3.1.  In  this  figure,  it  is  important  to  point  out  that  the  horizontal 
projection  of  the  point  of  dichotomization,  yg,  across  the  bivariate  normal  distribution  runs  parallel  to  the 
conditional  distributions  of  0  given  £g.  Hence,  these  distributions  and  thus  their  means  and  variances  are 
undisturbed  by  the  binary  scoring  of  item  g  based  on  Zg .  As  will  later  be  seen,  the  means  and  variances  of  0 
given  £g  are  left  undisturbed  by  another  method  of  binary  scoring  for  a  multiple-choice  item  g  that  is  determined 
by  Zg.  These  relationships  will  become  important  when  selection  theory  is  considered  in  Chapter  5.  These 
relationships  can  be  sharply  contrasted  with  those  presented  in  Figure  2.1.1  where  the  bisection  of  the  Zg(0) 
based  on  the  binary  scoring  of  item  g,  the  dichotomization  of  Zg,  gives  rise  to  the  item  characteristic  curve  of 
Figure  2.1.2. 

In  Figures  2.1.1  and  2.3.1,  the  bivariate  normal  distribution  is  represented  as  consisting  of  conditional 
distributions  with  unit  area  that  are  homoscedastic  and  univariate  normal.  Though  accurate,  this  representation 
is  not  the  typical  representation.  The  typical  representation  is  displayed  in  Figure  2.3.2  In  this  figure,  the  bivariate 
normal  distribution  is  represented  by  a  configuration  of  ellipses,  each  arising  from  the  display  of  points  of  equal 
joint  density.  This  representation  more  closely  resembles  the  sample  counterpart  of  the  bivariate  normal  distri¬ 
bution,  the  bivariate  normal  scatterplot.  The  apparent  dissimilarity  between  Figure  2.3.2  and  Figures  2.1.1  and 
2.3.1  is  easily  resolved.  The  relative  frequency  within  each  conditional  distribution  is  given  by  the  univariate 
normal  density  function  for  the  fixed  value  of  the  marginal  variable.  This  relationship  is  made  explicit  in  (2.3.12) 
for  6  and  in  (2.3.24)  for  £g.  Thus,  one  may  choose  to  take  into  account  the  relative  frequencies  or  marginal 


Figure  2.3.1  Hypothetical  relations  among  the  item  continuum  Zg9  the  free-response,  binary  item  Ug9  the 
conditional  distributions  of  0  given  £g,  and  the  latent  trait  0. 
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densities.  In  this  type  of  representation,  one  arrives  at  the  typical  portrayal  presented  in  Figure  2.3.2.  The  manner 
of  portrayal  of  the  bivariate  normal  distribution  is  thus  optional.  The  choice  of  a  particular  manner  depends  then 
on  the  relationships  that  are  to  be  explained. 

In  the  discussion  that  follows,  convenient  expressions  are  derived  for  various  terms.  These  derivations 
will  begin  with  the  defining  relationships  within  the  bivariate  normal  distribution.  During  this  initial  stage  of 
derivation,  the  reader  may  find  Figure  2.3.2  helpful  in  visualizing  the  particular  defining  relationship  that  serves 
as  a  basis  for  the  derivation. 

The  Unconditional  Probabilities  for  the  Realizations  of  Ug 

The  binary  random  variable  U g  can  realize  one  of  two  possible  values,  either  one  or  zero ,  indicating  a 
correct  or  an  incorrect  answer,  respectively,  to  free-response  item  g.  Expressions  will  now  be  derived  for  the 
probabilities  of  these  two  possible  outcomes. 

The  Probability  of  A  Correct  Answer  to  Item  g.  Pr(ws  =  1).  This  unconditional  probability  is  more 
commonly  referred  to  as  the  p-value  for  item  g;  however,  in  this  context  it  shall  be  designated  as  Pg.  By  definition 
it  is  known  that 


ps  =  Pr(nA,  =  1)  =  Pt(ZK  2=  yg)  =  <M£K,0)  d6  d(„,  (2.3.26) 

JyH  J  * 

where  the  rightmost  term  is  the  integral  over  the  plane  from  yg  to  positive  infinity  on  Zg  and  from  negative 
infinity  to  positive  infinity  on  O.  It  should  be  noted  that  yg,  because  of  (2.1.13),  can  be  conveniently  expressed 
as 


yH  =  P(Zg,0)  b 


where  p(Z^,,0),  because  of  (2.1.12),  can  be  conveniently  expressed  as 


f*Zg,0) 


(1 


(2.3.27) 


(2.3.28) 


u 


a 


g 


=  0  (Unshaded  Area- 


=  1  (Shaded  Area i 


Figure  2.3.2  A  typical  display  of  the  bivariate  normal  distribution  (including  the  univariate  normal  marginal 
distributions  of  Zg  and  O). 
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After  a  substitution  from  (2.3.16)  into  the  rightmost  term  in  (2.3.26),  the  integral  in  (2.3.26)  can  be 
expressed  as 


-r 

J  y 


/ 


(277)  -5  exp(- .5£2)  dL\  (277)  -5[1  -p2(Zg,0)]  5  exp  -.5 


e-P(ZK,e)  &  I2 

[I  -p2(Z„0))' 


de. 


where  substitutions  from  (2.3.18)  and  (2.3.20)  yield 


-r 

J  y 


I 


(277)--5  exp(-.5 £)dL  5  exp{  — .5[0(£s)]2}  dd(L). 


Again,  it  is  to  be  noted  that  the  rightmost  integral  in  (2.3.30)  is  unity,  which  allows  the  writing  of 


(27t)~*5  exp(- .5&)dL  =  (2tt)-5  exp(- .5g)  =  <Pf-y,), 


(2.3.29) 


(2.3.30) 


(2.3.31) 


where  <P  (*)  is  by  definition  the  cumulative  normal  distribution  function.  The  equality  of  integrals  in  (2.3.31) 
is  due,  again,  to  the  symmetry  of  the  normal  distribution.  The  probability  of  a  correct  answer  to  item  g,  Pg ,  is 
pictorially  represented  by  the  shaded  area  in  the  marginal  distribution  of  Zg  in  Figure  2.1.1.  This  representation 
is  possible  because  the  truncated  marginal  distribution,  as  can  be  seen  in  the  developments  from  (2.3.29)  to 
(2.3.31),  merely  summarizes  the  truncated  joint  distribution  for  Zg. 

The  Probability  of  An  Incorrect  Answer  to  Item  g,  Pr  (ug  =  0).  As  will  become  evident,  this  unconditional 
probability  is  the  complement  of  Pg  or  (1  -  Pg ),  because  the  area  under  the  normal  curve  is  unity.  Let  this 
probability  be  designated  as  Qg.  By  definition  then,  it  is  known  that 

Qg  =  Pr (ut  =  0)  =  Pr (Zg<yg)  =  ff  f  %  <j>(£g,d)  dd  d£g,  (2.3.32) 


where  the  rightmost  term  is  the  integral  over  the  plane  from  negative  infinity  to  yg  on  Zg  and  from  negative 
infinity  to  positive  infinity  on  O.  After  a  substitution  from  (2.3.16)  into  the  rightmost  term  in  (2.3.32),  this 
integral  can  be  expressed  as 

Qg  =  If  (2^~5  exp(  — .5$  d(g  J_x  (277)--5[l-p  2(Z,,0)]"5  exp(  -.sj  ^  Z^z^O)]-5  }  )  d°' 


(2.3.33) 

where  substitutions  from  (2.3.18)  and  (2.3.20)  provide 

Qg  =  ff  (2t7)--5  exp(-.5^)  di,  (  ^  (2t7)--5  exp{- ,5[0(g]2}  d8(Q.  (2.3.34) 

Again,  it  is  to  be  noted  that  the  rightmost  integral  is  unity,  which  allows  the  writing  of 

Qg  =  jf  (2 77)-  5  exp(-.5£)  dCg  =  <p(yg),  (2.3.35) 

where  <P(*)  is  again  the  cumulative  normal  distribution  function. 

It  is  now  apparent  from  a  review  of  (2.3.31)  and  (2.3.35)  that  Pg  and  Qg  are  complementary  terms.  These 
terms  account  for  the  entire  area  in  the  normal  distribution  where  this  area  is  unity.  The  probability  of  an  incorrect 
answer  to  item  g,  Qg ,  is  portrayed  in  Figure  2.1.1  as  the  unshaded  area  in  the  marginal  distribution  of  Zg.  This 
representation  is  possible  because,  as  can  be  seen  in  the  developments  from  (2.3.33)  to  (2.3.35),  the  truncated 
marginal  distribution  merely  summarizes  the  truncated  joint  distribution  for  Zg. 

The  Conditional  Means  of  Zg  Given  the  Realizations  of  Ug 

The  mean  of  Zg  can  assume  only  one  of  two  possible  values  depending  on  whether  item  g  was  answered 
correctly  or  incorrectly.  Expressions  will  now  be  derived  for  these  means  or  expected  values  for  the  two  possible 
outcomes. 
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The  Mean  of  Zg  Given  a  Correct  Answer  to  Item  g,  ft(Zg  |  ug  =  1).  This  mean  is  defined  by 


1 

“«  =  »  =  %(ZH  1 «,  =  1)  =  /  f  x  4  4>*(4’0) dd  ^4. 

yx  00 

(2.3.36) 

where  is  the  joint 

given  by 

density  function  for  this  particular  double  integral.  This  joint  density  function  is 

4>*(Cg*0)  =  — p — , 

(2.3.37) 

where  it  is  necessary  to  show  that  the  probability  integral 

J  J_x  ^*(4’0)  d0  d£g 

yx 

(2.3.38) 

equals  unity  in  order  to  verify  that  (2.3.37)  is  the  joint  density  function.  Since  the  reciprocal  of  Pg  is  a  constant 
with  respect  to  the  integration  of  (2.3.38),  a  substitution  from  (2.3.37)  into  (2.3.38)  yields 

J  l  f_x<f>(^e)d6d^  (2.3.39) 


which  may  be  seen  to  equal  unity  because  of  (2.3.26).  The  substitution  of  (2.3.37)  into  (2.3.36)  leads  to 

1*2*  I  «,  =  1)  =  J  Jr  J_x  4  <K£g,0)  de  d£g,  (2.3.40) 

which  follows  from  the  defining  relationship  stated  in  (2.3.36).  After  substituting  from  (2.3.16)  into  (2.3.40) 
and  proceeding  with  the  integration,  one  may  write 


MZ*  I  «,  =  i) 


.j-r 

P,>y. 


/ 


4(27r)-sexp(-.5^)^  (27r)--5ll-p2(Z,,0)]--5exp  -.5 


e-P{ZK,0)Cs 

[1  -p2(Z„0)]-5 


de 


(2.3.41) 

where  substitutions  from  (2.3.18)  and  (2.3.20)  provide 

|  ug  =  ')  =  7T  J  4  (2ir)--5  exp(-.5^)  d£g  [  ( 2ir)~  5  exp{  - .5[0(f,)]2}  d6(L).  (2.3.42) 

rg  yg  J  ~X 

Again,  it  is  to  be  noted  that  the  rightmost  integral  in  (2.3.42)  is  unity,  which  allows  one  to  write,  merely, 

ti(Zg  |  Ug  =  0  =  ~[  4(277-)- 5  exp(  — .54)  d£g,  (2.3.43) 

rZ  yg 


where  the  antiderivative  of  the  integrand,  which  is  required  in  subsequent  development,  is  known  to  be 

-  <H 4)  =  -  (2tt-)--5  exp(-.54).  (2.3.44) 

That  (2.3.44)  provides  the  antiderivative  of  the  integrand  in  (2.3.43)  can  be  verified.  One  can  take  the  derivative 
of  (2.3.44)  with  respect  to  the  variable  of  integration.  This  derivative  must  then  equal  the  integrand.  By  way  of 
verification,  the  derivative  of  (2.3.44)  with  respect  to  the  variable  of  integration  is  found  to  be 

d  [-(2tt)--5  exp(-,54)]  ,  d  exp(-  .54) 

*{,  ~  '  ’  it, 

-  -  t2^)-»exp(-.5g)-~;5f')  =  f,  <2w)-sexp(-.5©,  (2.3.45) 

where  the  rightmost  equality  is  indeed  the  integrand  in  (2.3.43). 
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A  solution  for  an  integral  usually  consists  of  evaluating  the  antiderivative  of  the  integrand  at  the  upper 
and  lower  limits  of  integration  and  obtaining  the  simple  difference.  But  the  upper  limit  in  (2.3.43)  is  positively 
infinite.  Thus,  the  limit  of  the  integral  must  be  evaluated  as  b ,  the  upper  limit,  approaches  infinity: 


r 

Jy 


b  ->  *  J  y 


L(2iry  -5  cxp(~. 5 £)dL  =  lira  L  (2tt)--5  exp(- .5®  d£g  =  lim  [-<£(&)  + (2.3.46) 


Because  the  antiderivative  at  b,  —  <j>{b),  approaches  zero  as  b  becomes  positively  infinite,  it  is  known  that 


/’ 

Jy 


lg  (277)  -5  exp(-.5g)  dCg  =  <£(7*), 


where  a  substitution  from  (2.3.47)  into  (2.3.43)  provides  the  desired  result 

p(Zg  |  u  =  1)  =  — — 


(2.3.47) 


(2.3.48) 


Thus,  the  mean  of  Zg  given  a  correct  answer  to  item  g9  fi(Zg  \  ug  =  1),  is  simply  the  value  of  the  density  at  yg 
in  the  standard  normal  distribution,  <£(yg),  divided  by  the  unconditional  probability  of  a  correct  answer  to  item 

g’Pr  ,  .  .  . 

The  Mean  of  Zg  Given  an  Incorrect  Answer  to  Item  g,  /x(Zg  |  ug  =  0).  This  mean  is  defined  by 


/j.  (Zg  |  ug  =  0)  =  %(Zg  |  ug  =  0)  = 


/: 


L  4>\L,d)dddL, 


(2.3.49) 


where  (j)f(^g,6)  is  the  joint  density  function  for  this  particular  double  integral.  This  joint  density  function  is  given 


by 


<M4 ,0) 


=  Qg 


where  it  is  necessary  to  show  that  the  double  integral 


<f>\L,6)  dOdL 


(2.3.50) 


(2.3.51) 


equals  unity  in  order  to  verify  that  (2.3.50)  provides  the  joint  density  function.  Since  the  reciprocal  of  Qg  is  a 
constant  with  respect  to  the  integration  of  (2.3.51),  a  substitution  from  (2.3.50)  into  (2.3.51)  provides 

e* 


x  J  -  x 


4>(£g,e)  d6  d£g,  (2.3.52) 

which  may  be  seen  to  equal  unity  because  of  (2.3.32).  The  substitution  of  (2.3.50)  into  (2.3.49)  leads  to 

lx(Zg  I  tig  =  0)  =  T  i*  I  4  <M4,0)  dd  dig.  (2.3.53) 

\lg  J  _0C  J  _oc 

After  substituting  from  (2.3.16)  into  (2.3.53)  and  continuing  with  the  integration,  one  may  write 


fx(Z  |  ug  -  0) 


=  —  P 

0„  J 


I 


L  (27r)“  5  exp(— .54)  dL  [1  -p2(Zg,6)}  exp  -.5 


8  -P(Zg,9)lg 

[l-p2(Z„,0)] 


where  substitutions  from  (2.3.18)  and  (2.3.20)  provide 


dd, 

(2.3.54) 


fx(Z  |  u  =  0) 


-if- 


4  (2'7r)  '5  exp(  — .5^|)  dig  (27T)-  5exp{-.5[e(lg)]2}dd(lg).  (2.3.55) 


Again  it  is  to  be  noted  that  the  rightmost  integral  is  unity,  which  allows  one  to  write 

1 


MZg  I  «*  =  0)  =  —  4  (2tt)  --5  exp(—  .5£|)  dlg, 

He  J  x 


(2.3.56) 
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where  the  antiderivative  of  the  integrand  in  (2.3.56)  is  given  in  (2.3.44)  and  verified  as  such  in  (2.3.45).  A 
solution  for  an  integral  usually  consists  of  evaluating  the  antiderivative  at  the  upper  and  lower  limits  of  integration 
and  obtaining  the  simple  difference.  But  the  lower  limit  is  negatively  infinite.  Thus,  the  limit  of  the  integral 
must  be  evaluated  as  a,  the  lower  limit,  approaches  negative  infinity: 

J  ig  (2 tt)--5  exp(-.5^M&  =  lim  P*  £g  (2t r)"-5  exp(-.5£2)  ^ 

*  *  (2.3.57) 

=  lim  yg)  +  <Ka)]- 

Cl  — *■  —  x 

Because  the  antiderivative  at  a,-<f>(a),  approaches  zero  as  a  becomes  negatively  infinite,  it  is  known  that 

/-l  &  (277)_’5  exP(  —  -5£g)  dCg  =  -  4>(yg)  (2.3.58) 

where  a  substitution  from  (2.3.58)  into  (2.3.56)  provides  the  desired  result 

/X(ZS  |  Ug  =  0)  =  -  .  (2.3.59) 

Thus,  the  mean  of  Zg  given  an  incorrect  answer  to  item  g ,  \x{Zg  \  ug  =  0).  is  simply  the  negative  of  the  value 
of  the  density  at  yg  in  the  standard  normal  distribution,  -  <$>(yg ),  divided  by  the  unconditional  probability  of  an 
incorrect  answer  to  item  g,  Qg, 


The  Conditional  Variances  of  Zg  Given  the  Realizations  of  Ug 


The  variance  of  Zg  can  assume  only  one  of  two  possible  values  depending  on  whether  the  item  was 
answered  correctly  or  incorrectly.  Expressions  will  now  be  derived  for  these  variances  given  the  two  possible 
outcomes. 

The  Variance  of  Zg  Given  a  Correct  Answer  to  Item  g,  cr(Zg  \  ug  -  1).  In  solving  for  the  variance  of 
Zg  given  a  correct  answer  to  item  g,  an  expression  is  found  for  %(Z?g  \  ug  =  1).  This  quantity  represents  the 
expected  value  of  the  sum  of  squared  deviations  from  a  mean  that  was  appropriate  before  the  truncation  of  Zg 
at  y^.  Later,  an  expression  is  obtained  for  the  desired  variance,  cr(Zg  \  ug  =  1)  or  the  expected  value  of  the 
sum  of  the  squared  deviations  about  the  mean  subsequent  to  this  truncation,  through 

°~2(Zg  I  Ug  =  1)  =  I  Ug  =  I)  -  /i2(Zs  I  Ug  =  1),  (2.3.60) 

which  is  an  explicit  solution  for  v2(Zg  |  ug  =  1)  given  the  identity 

I  Ug  =  1)  =  a2(Zg  |  ug  =  1)  +  ix2(Zg  |  ug  =  1).  (2.3.61) 

Proceeding  with  the  solution  for  %{Z?g  \  ug  =  1),  it  is  known  by  definition  that 

%{Z2  I  Ug  =  1)  =  J  f_x  Cg  4>*(£g,6)  dd  dZg,  (2.3.62) 

where  4>*(Cg,d)  is  given  in  (2.3.37)  and  verified  as  the  joint  density  function  in  the  discussion  surrounding 
(2.3.39).  A  substitution  from  (2.3.37)  into  (2.3.62)  allows  one  to  write 

%{Z]\Ug=  \)  =  [  Cl  <HCg,0)  dd  dCg.  (2.3.63) 

After  substituting  from  (2.3.16)  into  (2.3.63)  and  continuing  with  the  integration,  one  may  write 


%{Zl  |  Ug  =  1) 


-if 

P.  J y 


£(2iry 


exp(-.5£2)  dC 


if. 


(2tt)  -Ml-P 2(Zg,e)]~-5 


exp 


.5 


-p(zg,e)c„  y\ 
[1  ~  P2(Zg,0)]'5  j  J 


where  substitutions  from  (2.3.18)  and  (2.3.20)  provide 


(2.3.64) 


*CZg  |  Ug  =  1)  =  7T  f  4-  (277)--5  exp(-.5£)  </£,  [  (2t7)--5  exp{- ,5[0(4)]2}  rffl(4).  (2.3.65) 

Again,  it  is  to  be  noted  that  the  rightmost  integral  in  (2.3.65)  is  unity,  which  allows  the  writing  of 

I  H*  -  1)  =  ~  f  l\  (27 r)  5  exp(-.5^)  rff  (2.3.66) 

V  JyK 

where  it  is  customary  to  solve  for  this  integral  through  the  method  of  integration  by  parts.  One  begins  by  defining 
r  and  5  as 


'  =  4 

(2.3.67) 

and 

5  =  -  <K 4>  =  -  (2tt)--5  exp(—  .5  £j). 

(2.3.68) 

Notice  that  the  derivative  of  r  with  respect  to  £g  is  unity: 

dr  _d£s  _ 

dig  d£g 

(2.3.69) 

Thus  the  differential  of  r  in  relation  to  that  of  ^  is  given  by 

II 

■ts 

(2.3.70) 

Note  further  that  the  derivative  of  s  with  respect  to  £g  was  previously  given  by  (2.3.45).  After  a  substitution 
from  (2.3.68)  into  (2.3.45),  it  is  known  that 

ds 

—  =  4  (2tt)--5  exp(-  .5  4).  (2.3.71) 

Therefore,  the  differential  of  s  with  respect  to  that  of  is  provided  by 

ds  ~  {2iry  5  exp(-.5  £*)  d£g.  (2.3.72) 


Continuing  with  integration  by  parts,  the  simple  differential  of  a  product  is  used: 

dir  s)  =  r  ds  +  s  dr.  (2.3.73) 


Transposing  (2.3.73),  it  is  found  that 

r  ds  —  d{r  s)  —  s  dr  (2.3.74) 

where  substitutions  from  (2.3.67),  (2.3.68),  (2.3.70)  and  (2.3.72)  into  (2.3.74)  are  now  possible.  These  sub¬ 
stitutions  result  in 

4  (2 it)--5  exp(—  .5  4)  d£g  =  c/[-4(2t7)--5  exp(-.5  £)]  +  5  exp(-,5  g)  d£g.  (2.3.75) 

Upon  integrating  (2.3.75),  it  is  known  that 


4(277)-  5  exp(-.5  4)  d(g 

=  £  d[-Cg( 2ir)“  5  exp( - .5  £)]  +  £  (2ir)  5  exp(-.5  g)  (2.3.76) 


where  the  first  integral  on  the  right  side  of  the  equality  requires  further  attention.  Because  of  (2.3.68),  it  is 
known  that 


f  d[-  4(27r)-  5exp(-.5  £)]  =  f  <H-  <K£g)].  (2.3.77) 

yg  y« 

Since  the  integrand  in  (2.3.77)  is  unity,  the  antiderivative  is  merely  the  variable  of  integration,  —£s<f>(£g).  A 
solution  for  this  integral  is  obtained  by  evaluating  the  limit  of  the  integral  as  the  upper  limit  of  integration,  b , 
approaches  positive  infinity.  It  is  known,  therefore,  that 
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f 

Jy 


b  ^  J  r 


/. 


d[-~L(2if)  5  exp(  —  .5  4)]  =  lim  4“  4^4)1  =  lim  [-&<£(*)  +  (2.3.78) 


b  -+  * 


where  the  antiderivative  evaluated  at  Z?,  —  Z?  </>(Z?),  approaches  zero  as  b  becomes  positively  infinite.  It  is  then 
found  that 


(2.3.79) 


d[-  4(2 7T)  5  exp(  —  .5  4)  =  rg  <Myg)- 
Substitutions  from  (2.3.79)  and  (2.3.31)  into  (2.3.76)  allow  one  to  write 

I  C]  (2t7)-*5  exp(  —  .5  CD  d  4  =  yg  <Kyg)  + 
which  can  now  be  substituted  into  (2.3.66)  providing 

%(Z  |  M.  =  1)  =  1  +  ^  ^  . 


(2.3.80) 


(2.3.81) 


Substitutions  from  (2.3.81)  and  from  the  squared  result  of  (2.3.48)  into  (2.3.60),  along  with  some  rearrangement, 
now  yield  the  desired  result 


or  (Zg  \  u  =  1)  =  1 


<f>(yg)  ( <t>(yg) 


(2.3.82) 


as  a  convenient  expression  for  the  variance  of  Zg  given  a  correct  answer  to  item  g. 

The  Variance  of  Zg  Given  an  Incorrect  Answer  to  Item  gt  o2(Zg  \  ug  =  0).  In  solving  for  the  variance 

of  Z g  given  an  incorrect  answer  to  item  g,  an  expression  is  found  for  %(Zf,  \  ug  =  0).  This  quantity  represents 

the  expected  value  for  the  sum  of  squared  deviations  from  the  mean  that  was  appropriate  before  the  truncation 
of  ZL>  at  yg.  Later,  an  expression  is  obtained  for  the  desired  variance  or  the  sum  of  squared  deviations  about  the 
mean  subsequent  to  this  truncation,  o2(Zg  \  ug  =  0),  through 

o2  (Zg  |  ug  =  0)  =  %{Z?g  |  Ug  =  0)  -  fx2(Zg  |  ug  =  0),  (2.3.83) 

which  is  an  explicit  solution  for  o2(Zg  \  ug  =  0)  given  the  identity 

%(Zfg  |  ug  =  0)  =  o2(Zg  |  Ug  =  0)  +  H2(Zg  |  ug  =  0).  (2.3.84) 

Proceeding  with  the  solution  for  %(Z?g  |  ug  =  0),  it  is  known  by  definition  that 


%{Zi  K  =  o)  =  x  de  dcg. 


(2.3.85) 


where  <P(Cg,0)  is  provided  in  (2.3.50)  and  verified  as  the  joint  density  function  in  the  discussion  surrounding 
(2.3.52).  A  substitution  from  (2.3.50)  into  (2.3.85)  allows  one  to  write 


%(2Z  |  ug  =  0) 


±  n  r 

j 


&  4>(L,e)  de  dL. 


(2.3.86) 


After  substituting  from  (2.3.16)  into  (2.3.86)  and  continuing  with  the  integration,  one  may  write 
%{2%  |  ug  =  0) 


_  o„  J-° 


{ 


S  (2 7T)--5  exp(— .54)  dL  (277)"-5  [1  -  p^Z.,©)]-5  exp  -.5 


e  -  p(Zg,e)  4  v 
[i  -  TizZeyp 


de, 


(2.3.87) 


where  substitutions  from  (2.3.18)  and  (2.3.20)  provide 


%{Z1g  |  ug  =  0)  = 


/: 


/: 


4  (2tt)--5  exp(  —  .5  42)  dCg  (2tt)-'5  exp{-.5  [0(4)]2}  d6(L).  (2.3.88) 
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(2.3.89) 


Again,  it  is  to  be  noted  that  the  rightmost  integral  is  unity,  which  allows  one  to  write 

%(Zl  |  Ug  =  0)  =  j-  [  *  i]  (2 77)  -  exp(-  .5  Q)  dig, 

where  it  is  customary  to  solve  this  integral  through  the  method  of  integration  by  parts.  Again,  the  definitions 
provided  in  (2.3.67)  and  (2.3.68)  along  with  their  consequences  as  given  in  (2.3.70)  and  (2.3.72)  are  used. 
Continuing  with  integration  by  parts,  the  simple  differential  of  a  product  is  again  used  as  in  (2.3.73)  and  (2.3.74), 
where  substitution  from  (2.3.67),  (2.3.68),  (2.3.70),  and  (2.3.72)  into  (2.3.74)  again  yields  (2.3.75).  Upon 
integrating  (2.3.75)  between  the  different  limits,  one  now  obtains 

J_‘x£g  (2tt)-  -5  exp(-  .5  £)  dig 

=  J_x  d[  —  ig  (2-Try  '  exp(-  .5  g)]  +  J  ^  (2i t)~-s  exp(-.5  £2)  d(g,  (2.3.90) 

where  the  first  integral  on  the  right  side  of  the  equality  again  requires  further  attention.  Because  of  (2.3.68),  it 
is  known  that 

J_x  d[~ig  (2-rr)  “-5  exp(-.5  i])]  =  J_^  d(  -  ig  <j>(£g)] .  (2.3.91) 

Since  the  integrand  in  (2.3.91)  is  unity,  the  antiderivative  is  merely  the  variable  of  integration,  ~ig  <)>(£,).  A 
solution  for  the  integral  in  (2.3.91)  is  obtained  by  evaluating  the  limit  of  the  integral  as  the  lower  limit  of 
integration,  a,  approaches  negative  infinity.  One  therefore  has 

f  d[-(g  (277)-- exp(—  .5  Q)}  =  lim  |  d[-£g  <j>(ig)] 

J  a  — *  J  o 

=  lim  [~yg  <f>(yg)  +  a  <t>(a)],  (2.3.92) 


where  the  antiderivative  evaluated  at  a,  —a  (b(a),  approaches  zero  as  a  becomes  negatively  infinite.  The  solution 
for  this  integral,  then,  is 

J  ^  d[~ig  (2t7)-  5  exp(-.5  i2g))  =  -  yg4>(yg).  (2.3.93) 

Substitutions  from  (2.3.93)  and  (2.3.35)  into  (2.3.90)  allow  one  to  write 

]_[  {g  (277)-  5  exp(—  .5  H)  dig  =  -  yg  <t>(yg)  +  Qg,  (2.3.94) 

which  can  now  be  substituted  into  (2.3.89),  yielding 

%(2}g  |  ^  =  0)  =  1  -  ^^2  .  (2.3.95) 

Substitutions  from  (2.3.95)  and  from  the  squared  result  of  (2.3.59)  into  (2.3.83),  along  with  some  rearrangement, 
now  yield  the  desired  result 


cP-(Zg  |  Ug  =  0)  = 


<t>(yg) 

Q* 


<t>(yg) 


Qx 


+  y* 


(2.3.96) 


as  a  convenient  expression  for  the  variance  of  Zg  given  an  incorrect  answer  to  item  g. 

The  expressions  for  the  variances  provided  in  (2.3.82)  and  (2.3.96)  will  have  further  use  in  later  derivations 
in  Chapter  5.  Specifically,  these  equations  will  provide  input  for  the  derivations  of  the  restricted  variances  of 
ability  given  the  realizations  of  the  binary  variable  Ug. 


The  Least  Squares  Estimators  of  Ability  Given  the  Realizations  of  Ug 

Since  the  mean  is  the  point  about  which  the  sum  of  squared  discrepancies  is  minimized,  least  squares 
estimators  of  ability  for  the  possible  realizations  of  the  binary  variable  Ug  are  readily  obtained. 
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Specific  Case .  For  the  specific  case  where  O  has  a  mean  of  zero  and  a  variance  of  unity  these  estimators 
are  merely  the  means  of  0  given  the  two  possible  outcomes:  the  mean  of  G  given  a  correct  answer  to  item  g, 
p,(0  |  ug  =  1),  and  the  mean  of  O  given  an  incorrect  answer  to  item  g,  p,(0  \  ug  =  0).  These  least  squares 
estimators  of  ability  will  now  be  derived  for  the  specific  case. 

Specific  Case:  The  Mean  of  0  Given  a  Correct  Answer  to  Item  g,  /x(0  |  ug  =  1).  In  order  to  obtain  a 
convenient  expression  for  the  mean  of  0  given  a  correct  answer  to  item  g,  p{0  \  ug  =  1),  it  is  necessary  to 
evaluate  the  defining  relationship 

P*0  I  ng  =  1)  =  *(6  I  Ug  =  1)  =  f  j_x  e  d6  dCH,  (2.3.97) 

where  c p*(£g,0 )  is  given  in  (2.3.37)  and  verified  as  the  joint  density  function  in  the  discussion  surrounding 
(2.3.39).  A  substitution  from  (2.3.37)  into  (2.3.97)  allows  one  to  write 

M(0  I  ug  =  1)  =  *(0  I  ug  =  1)  =  T  |  I  e  ^e)  de  (2.3.98) 

After  a  substitution  from  (2.3.16)  into  (2.3.98),  one  may  write 
p{0  |  ug  =  1)  =  %{0  |  ug  =  1) 

«  -  P(Z,,6)  (, 

u  -  eHz„e)\>\ )  M(2*r  5exP(--5 


■kIT- 


0  (2tt)  5  [1  -  p2(Z„,Q)]  5  exp 


where  substitutions  from  (2.3.18)  and  (2.3.20)  provide 
H(G  |  ug  =  1)  =  %{Q  |  ug  =  1) 

=  t\  \  0(27r)--5exp{ 

rg  Jy  J-OC 


The  innermost  integral  in  (2.3.100)  is  merely  the  expected  value  of  0  given  £g,  %(0  \  £g),  which  can  be 
represented  in  Figure  2.3.1  as  the  value  of  the  coordinate  of  0  for  a  point  on  the  line  of  regression  of  0  onto 
£g  labelled  %(0  |  fg),  where  the  coordinate  of  Zg  is  the  particular  fixed  value  The  value  that  this  integral 
assumes  is  merely  the  product  p{Zg,0)  as  will  soon  become  evident.  Proceeding  with  an  evaluation  of  this 
innermost  integral,  one  solves  (2.3.18)  explicitly  for  6  where  this  solution  is 

e  =  [1  -  ft(Zg,G)]-5  kcg)  +  p(Zg,G)  Zg.  (2.3.101) 

After  a  substitution  of  (2.3.101)  into  the  innermost  integral  in  (2.3.100),  one  can  write 
/  0(277)--5  exp{-.5  [6(Cg)}2}  d0(Q 

=  J _x  {[1  -  P2(Zg,G)]  5  ()(Q  +  P(Zg,G )  4}  (2tt)- 5  exp{  —  .5  [0(4)]2}  d~0(Q. 

The  integral  on  the  right  side  of  (2.3. 102)  can  be  expressed  as  a  sum  of  two  integrals 
f  x  6  (2t7)-  -5  exp{-  .5  1 0  (4)]2}  dO(Cg) 

=  [1  -  (p-{Zg,G)\5  J  ^  0(Zg)  (2tt)~-5  exp{  —  .5  [0(4)]2}  dd(Q 
+  p(Zg,G)  Cg  |  ^  (27t)-  j  exp{-  .5  [Q(Zg)]2}  d0(Q, 


(2.3.102) 


(2.3.103) 


(2.3.99) 

-  .5[0  (4)]2}  dd(Q  (2tt)--5  exp(-  .5  g)  dZg. 

(2.3.100) 
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where  some  of  the  constants  in  the  integration  have  been  written  outside  of  the_  integrals  for  convenience.  The 
first  integral  on  the  right  side  of  the  equality  in  (2.3. 103)  is  merely  the  mean  of  0((g),  p.{0(^)}  which  is  known 
to  be  zero.  Thus,  the  product  represented  by  the  first  term  on  the  right  side  of  the  equality  in  (2.3.103)  is  also 
zero.  The  second  integral  on  the  right  side  of  the  equality  represents  the  total  area  in  the  standard  normal 
distribution  which  is  known  to  be  unity.  Thus,  one  may  write 

f_x  0  (2^7 )-'5  exp{—  .5  [e(Q]2}  d6(Q  =  p(Zg,0)  4,  (2.3.104) 

which  can  be  substituted  into  (2.3.100),  producing 

KO\  ug  =  1)  =  %{0  I  Ug  =  1) 

=  7T  J  (*Zg,6)  4  (277)- 5  exp(  —  .5  £|)  c/4.  (2.3.105) 

"g  JyR 

Since  p(ZgyO)  is  a  constant  in  the  integration  of  (2.3.105),  one  has 

fx{0  |  ug  =  1)  =  %(0  |  Ug  =  1) 

=  p(Zg,0)~J  4  (277)-  5  exp(-.5  42)  c/4,  (2.3.106) 

"g  Jys 

where  a  substitution  from  (2.3.43)  yields 

p.(6  |  ug  =  1)  =  p(Zg,G)  n(Zg  |  ug  =  1)  (2.3.107) 

which  may  also  be  expressed  as 

n(0\ug  =  1)  =  p(Zg,0)^-f-  (2.3.108) 

because  of  (2.3.48).  Equation  (2.3  108)  represents  a  convenient  expression  for  the  least  squares  estimator  of  O 
given  a  correct  answer  to  item  g.  This  estimator  is  merely  the  product  of  a  regression  weight — in  this  case  the 
correlation  p(Zg,Q),  because  both  Zg  and  O  have  a  standard  deviation  of  unity — and  the  value  of  the  density 
at  yg  in  the  standard  normal  distribution,  (j>(yH),  divided  by  the  unconditional  probability  of  a  correct  answer  to 
item  g,  Pg. 

Specific  Case:  The  Mean  of  O  Given  an  Incorrect  Answer  to  Item  g,  p,(0  \  ug  =  0).  In  order  to  obtain 
an  expression  for  the  mean  of  6  given  an  incorrect  answer  to  item  g  one  must  evaluate  the  defining  relationship 

fx(G  |  Ug  =  0)  =  %(G  |  ug  =  0)  =  J  f  J_x  6  <^(4,0)  dd  c/4,  (2.3.109) 

where  4>  (4,0)  is  given  in  (2.3.50)  and  verified  as  the  joint  density  function  in  the  discussion  surrounding 
(2.3.52).  A  substitution  from  (2.3.50)  into  (2.3.109)  allows  one  to  write 

p.(0  I  II,  =  0)  =  %(0  I  ug  =  0)  =  d.  P  f  0  <K 4,0)  C/0  c/4.  (2.3. 1 10) 

After  substitution  from  (2.3.16)  into  (2.3.110),  one  may  write 

p,(0  |  Ug  =  0)  =  %{0  |  Ug  =  0) 

1  fi  r  /  f  6  ~  P(Zg,G)  4  -|2\ 

“  Qg  J- J-« 0(27r)"'5  [1  "  p2(^’e)r  5  exp(--5(p!-  _  Jtzfeyc]  )  de{l7T)~  5  exP(--5  42)  ^ 

(2.3.111) 

where  substitutions  from  (2.3.18)  and  (2.3.20)  provide 
pc(Q  |  Ug  =  0)  =  %(0  |  ug  =  0) 

=  ^ 0(27r)~'5exp{--5  [^(4)]2}c/0(4)  (277)--5  exp(-.5  4)  c/4.  (2.3.112) 
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The  innermost  integral  in  (2.3.1 12)  is  again  equal  to  %{6  |  (g),  or  the  product  p(Zg,G)  for  each  particular 
value  of  Zg  as  proved  in  (2.3.104).  A  substitution  from  (2.3.104)  into  (2.3.112)  then  allows  the  writing  of 

fx{6  |  w*  =  0)  =  %{G  |  ug  =  0) 

=  \  p(ZgyG)  4(2tt)--5  exp(  —  .5  42)  d£gy  (2.3.113) 

where  the  constant  p(Zg,G)  may  be  written  outside  of  the  integral.  One  then  has 
p,(Q  |  ug  —  0)  =  %{G  |  ug  =  0) 

=  p{Zg,e )  T  P  4(2tt)--5  exp(  —  .5  Q)  d£g,  (2.3.114) 

Ug  J  x 

where  a  substitution  from  (2.3.56)  allows  one  to  write 

n(e  |  uH  =  o)  =  p(Z,,e)  |  Ug  =  o)  (2.3. 1  is> 

which  may  also  be  expressed  as 

M©  I  ug  =  0)  =  -  p(Z,,0)  (2.3.116) 

because  of  (2.3.59).  Equation  (2.3.1 16)  provides  a  convenient  expression  for  the  least  squares  estimator  of  G 
given  an  incorrect  answer  to  item  g.  This  estimator  is  merely  the  negative  of  the  product  of  a  regression  weight — 
in  this  case,  p(Z^,0),  because  both  ZR  and  G  have  standard  deviations  of  unity — and  the  value  of  the  density 
at  yR  in  the  standard  normal  distribution,  4>(yg),  divided  by  the  unconditional  probability  of  an  incorrect  answer 
to  item  g,  Qg. 

General  Case.  The  general  case  allows  the  examiner  to  prescribe  the  scale  of  ability  or  the  mean  and 
variance  of  0*,  /x(0*)  and  6 *).  Under  this  case,  G  may  be  viewed  as  resulting  from  the  standardization  of 
0* 


6*  -  p(0*) 

cr(0*) 


(2.3.117) 


where  this  relationship  indicates  that  0  and  are  equal  when  p<(0*)  equals  zero  and  cr(0*)  equals  unity.  Thus, 
the  general  case  subsumes  the  specific  case.  In  the  general  case,  it  is  to  be  noted  that 

0*  =  0  a(0*)  +  p(0*)  (2.3.118) 

when  (2.3.117)  is  solved  explicitly  for  0*. 

A  note  of  explanation  is  in  order  for  applications  of  the  general  case.  The  item  parameters,  ag  and  b{,  of 
(2.1.12)  and  (2.1.13),  respectively,  are  not  appropriate,  except  in  one  instance,  for  the  general  case.  The  sole 
exception  is  the  subsumed  specific  case.  For  the  general  case,  these  parameters  require  transformations  that 
produce  a  particular  invariant  result.  When  a  desired  mean,  p,(0*),  and  variance,  cr(0*),  have  been  prescribed, 
the  particular  transformations  are  then  known.  These  transformations  provide 


and 


a„ 

a*  —  - — 

*  (7(0*) 


(2.3.119) 


b*  =  bg  cr(0*)  +  p(0*)  (2.3.120) 

that  are  appropriate  in  the  general  case  which,  of  course,  subsumes  the  specific  case. 

The  point  of  dichotomization  on  the  standardized  conditional  distribution  of  Zg  given  0*  may  be  defined 

as 


yH(0*)  =  -  a*  (0*  -  b*).  (2.3.121) 

The  particular  invariant  result  which  must  be  produced  by  the  transformations  in  (2.3.119)  and  (2.3.120)  then 
requires  that 

yg(6)  =  y g(8*)  (2.3.122) 
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which  maintains  an  identical  point  of  dichotomization  on  the  Zg(0)  and  the  Zg(0*)  under  a  change  in  the  scale 
of  ability.  This  result  provides  that  the  probabilities  yielding  the  item  characteristic  curve  remain  undisturbed  by 
this  transformation  of  the  scale  of  ability.  Substitutions  from  (2.1.15)  and  (2.3.121)  into  (2.3.122)  yield 

-a,  (0  -  bg)  =  -a*  ( 6 *  -  b*).  (2.3.123) 

Subsequent  substitutions  from  (2.3.118),  (2.3.1 19),  and  (2.3.120)  into  (2.3.123)  provide  the  obvious  equality 

~ag  (0  -  bg)  =  -ag  (0  -  bg)  (2.3.124) 

in  proof  of  the  required  invariant  result  and  the  appropriateness  of  (2.3. 119)  and  (2.3.120)  for  the  general  case. 
Notice  that  the  property  of  invariance  does  not  pertain  to  the  parameters,  but  to  the  result  produced  by  particular 
transformations  of  the  parameters.  This  relationship  is  made  explicit  in  (2.3.123). 

The  property  of  invariance  illustrated  for  (2.3.122)  produces  a  desirable  result.  This  result  guarantees 
that  the  probability  of  obtaining  a  correct  answer  on  item  g  remains  invariant  under  arbitrary  prescriptions  for 
the  scale  of  ability,  that  is  the  mean  and  variance  of  0*,  and  o2(0*).  Later  in  the  discussion,  there  will 

be  further  cause  to  consider  the  property  of  invariance. 

For  subsequent  developments,  expressions  are  required  for  the  correlation,  p(Zg,0),  and  the  point  of 
dichotomization  on  the  continuous  variable  Zg,  yg,  given  the  parameters  a*  and  b*.  These  expressions  will  be 
derived  here  for  future  reference. 

In  order  to  obtain  an  expression  for  p(Zg,0)  given  a*,  (2.3.1 19)  is  solved  explicitly  for  ag.  This  solution 

yields 

=  a*  a(0*)  (2.3.125) 

which  can  then  be  substituted  into  (2.3.28)  to  provide  the  desired  results.  After  substitutions  from  (2.3.125)  into 
(2.3.28),  one  has 


p(Zg,0) 


a*  a{  0* ) 

(1  +  [a*  a(0*)]2}5' 


(2.3.126) 


an  expression  appropriate  for  the  general  case. 

An  expression  for  yg  given  b*  can  be  obtained  through  solving  (2.3.120)  explicitly  for  bg.  This  solution 

yields 


_  b*  -  pXO*) 
g  <t(0*) 


(2.3.127) 


which  can  then  be  substituted  along  with  (2.3.126)  into  (2.3.27)  to  provide  the  desired  result.  After  the  substitution 
of  (2.3.126)  and  (2.3.127)  into  (2.3.27),  one  may  write 


_  b*  -  /x(0*) 

^  [(a*)-2  +  cr^iO*)]5’ 


(2.3.128) 


an  expression  appropriate  for  the  general  case. 

For  the  general  case,  the  least  squares  estimators  of  ability  are  merely  the  means  of  0*  given  the  two 
possible  outcomes:  the  mean  of  0*  given  a  correct  answer  to  item  g,  p.(0*  |  «  =  1),  and  the  mean  of  0 * 
given  an  incorrect  answer  to  item  g,  p.{0*  \  ug  =  0).  These  estimators  of  ability  will  now  be  derived  for  this 
general  case. 

General  Case:  The  Mean  of  0*  Given  a  Correct  Answer  to  Item  g,  p{ 0*  |  n  =  1).  In  order  to  obtain 
an  expression  for  the  mean  of  0*  given  a  correct  answer  to  item  g,  one  must  evaluate  the  defining  relationship 

M(G>*  |  ug  =  1)  =  %{0*  |  Ug  =  1)  =  f  f_x  0*  <P((g,0 )  dddfg,  (2.3.129) 


where  <£*(£,, 0)  is  given  in  (2.3.37),  verified  as  the  joint  density  function  in  the  discussion  surrounding  (2.3.39), 
and  still  appropriate  because  of  (2.3.117)  and  (2.3.1 18).  A  substitution  from  (2.3.37)  into  (2.3.129)  allows  one 
to  write 


p(0*  |  Ug 


1)  =  %(0*  I  Ug  =  1)  =  y 

*  R 


e*  <H(g,e)  dOdfg. 


(2.3.130) 


34 


After  a  substitution  from  (2.3.16)  into  (2.3.130),  one  may  write 


M (0*  |  ug  =  1)  =  %{Q*  |  ug  =  1) 

=  ij-  f  [  0*(27T)“-5[1  -  (?(Zg,Q)\~-5 


(  fO-p(Zg,0)ig 

exp\  U1  -  p2(^.e»]5j  / 


dO(2Tr)  5  exp(- .5  £)  d£g, 


(2.3.131) 


where  substitutions  from  (2.3.18)  and  (2.3.20)  provide 

n(o*  |  ug  =  i)  =  %(e*  \ug=  i) 

=  2  f  f  0*  (2tt)--5  exp{-.5[0(£?)]2}  rffltf,)  (277)-  5  exp(-.5  £2)  d£g.  (2.3.132) 

The  innermost  integral  in  (2.3.132)  is  merely  the  expected  value  of  0*  given  £g9  %(Q*  \  £g),  which  represents 
the  value  of  the  coordinate  of  0*  for  a  point  on  the  line  of  regression  of  0*  onto  Zg  for  the  particular  fixed 
value  £g.  Proceeding  with  an  evaluation  of  (2.3.132),  a  substitution  from  (2.3.118)  into  the  innermost  integral 
in  (2.3. 132)  yields 

6 *  (2t7)“  5  exp{-.5(P(4)]2}  d~6(Q 

=  J_J0  a(0*)  +  /*(©•)]  (277)- 5  exp{-.5[0(4)]2}  dkCg).  (2.3.133) 

integral  on  the  right  side  of  (2.3.133)  can  be  expressed  as  a  sum  of  two  integrals 
d*  (277)- 5  exp{-.5[0(4)]2}  dkQ 

=  o-(0*)  f_x0( 2t7)--5  exp{-.5[0(4)]2}  dB(ig) 

+  p(0*)  f_"  (2t7)--5  exp{-.5[0(4)]2}  d~6(ig),  (2.3.134) 

where  some  of  the  constants  in  the  integration  have  been  written  outside  of  the  integrals  for  convenience.  The 
first  integral  on  the  right  side  of  the  equality  in  (2.3.134)  is  merely  the  product  p(Zg9S)  £g  as  given  by  (2.3. 104). 
Thus,  the  first  term  on  the  right  side  of  the  equality  in  (2.3.134)  is  merely  the  triple  product  p(Zg90)  <x(6J*)  £g. 
The  second  integral  on  the  right  side  of  the  equality  in  (2.3.134)  represents  the  total  area  in  the  standard  normal 
distribution  which  is  known  to  be  unity.  Thus,  the  second  term  on  the  right  side  of  the  equality  in  (2.3.134)  is 
merely  /i(0*).  Therefore,  one  may  write 

f  J*  (277)--3  exp{-.5[0(4)]2}  d~0(ig)  =  M(0*)  +  p(Zg,0)  (7(0*)  £g,  (2.3.135) 

which  can  be  substituted  into  (2.3.132)  producing 
M(0*  |  ug  =  1)  =  *(0*  |  ug  =  1) 

=  4  J  [/*(£*)  +  p(Zg,0)  (7(0*)  £g\  (277 )  5  exp(-.5£f)  dCg,  (2.3.136) 

*g  Jyg 

where  the  rightmost  equality  in  (2.3.136)  can  now  be  expressed  as  the  sum  of  two  integrals.  One  may  write 
jll(0*  |  ug  —  1)  =  ^(0*  |  ug  =  1) 

=  ^2  f  (277) -  5  exp(  -  .5  C2g)  dig 

+  p(Zg,0)  I  Cg  (2tt)--5  exp(  —  .5  i2g)  dig,  (2.3.137) 

rts  ys 
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where  some  of  the  constants  in  the  integration  have  been  written  outside  of  the  integrals  for  convenience. 
Substitutions  from  (2.3.31)  and  (2.3.43)  into  (2.3.137)  yield 

fx(6*  |  ug  =  1)  =  p{0*)  +  p(Zg,0)  cr(0*)  pt{Zg  |  ug  =  1);  (2.3.138) 

which  may  also  be  expressed  as 

p(0*  |  ug  =  1)  =  p.(0*)  +  p(Zg,6)  cr(0*)^4  (2.3.139) 

s 


because  of  (2.3.48).  This  estimator  is  merely  the  product  of  a  regression  weight — in  this  case  p{Zg,0)  <r(0*) 
because  Zg  has  a  standard  deviation  of  unity — and  the  value  of  the  density  at  yg  in  the  standard  normal  distribution, 
<£(%),  divided  by  the  unconditional  probability  of  a  correct  answer  to  item  g,  Pg,  added  to  the  mean  of  0*, 

General  Case:  The  Mean  of  0*  Given  an  Incorrect  Answer  to  Item  g,  p,(0*  |  ug  =  0).  In  order  to  obtain 
an  expression  for  the  mean  of  0*  given  an  incorrect  answer  to  item  g,  it  is  necessary  to  evaluate  the  defining 
relationship 


p(0*  K  =  0)  =  3(0*  i  ug  =  0)  =  0*  cp(£g,d)  dd  dCg,  (2.3.140) 

where  4>  (fg,0)  is  given  in  (2.3.50),  verified  as  the  joint  density  function  in  the  discussion  surrounding  (2.3.52), 
and  still  appropriate  because  of  (2.3.117)  and  (2.3.1 18).  A  substitution  from  (2.3.50)  into  (2.3.140)  allows  one 
to  write 

pie*  |  ug  =  o)  =  3(0*  |  ug  =  0)  =  -p-  r  f  e*  4>(4,0)  de  dt,g.  (2.3.  ui) 

J  *  J  oc 


After  a  substitution  from  (2.3.16)  into  (2.3.141),  it  is  found  that 
fi(Q*  |  ug  -  0)  =  %{Q*  |  ug  =  0) 


6*  (2tt)  5[1  -p2(Zg,0)]  5  exp 


.5 


0-p(Zs,0)4  \2\ 

[1  ~ P2(Zg,0)]  5  j  J 


dd(2ir)  -5exp(-.5 Q)  d£g 


(2.3.142) 

where  substitutions  from  (2.3.18)  and  (2.3.20)  provide 
pt(0*  |  ug  =  0)  =  3(0*  |  ug  =  0) 

=  ^  \\  f_x  0*  V*Y '-5  exp{-.5[0(4)]2}  dd(Q  (2t rp  5  exp(-.5£|)  d(g. 

(2.3.143) 


The  innermost  integral  in  (2.3.143)  is  the  expected  value  of  0*  given  £g,  3(0*  |  Q,  or  merely, 
p.(0*)  +  p(Zg,0)  cr(0*)4,  as  proved  in  (2.3.135).  A  substitution  from  (2.3.135)  into  (2.3.143)  then  allows 
the  writing  of 

H(6*  |  ug  =  0)  =  3(0*  |  ug  =  0) 

1  P* 

-  ~q  J_K  [p-(&*)  +  P(Zg,0)cr(6*){,g\{2n)  -5exp(-.5 (%)  d£g,  (2.3.144) 
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where  the  rightmost  equality  in  (2.3.144)  can  now  be  expressed  as  the  sum  of  two  integrals.  One  may  write 
fi(Q*  |  ug  —  0)  =  %{Q*  |  ug  =  0) 

Me*)  P*  5  ,  ,r2wr 

=  -Q—  ]_x  (27 T)  5  exp(-.5$  dig 
c r(0*)  p, 

+  p(Zg,0)^— ^  4  (2^)  *5  exp(— .5£|)  d£g,  (2.3.145) 

where  some  of  the  constants  in  integration  have  been  written  outside  of  the  integrals  for  convenience.  Substitutions 
from  (2.3.35)  and  (2.3.56)  into  (2.3.145)  allow  one  to  write 

lx(Q*  |  ug  =  0)  =  p(6*)  +  p(Zg,0)a(6*)fjL(Zg  \  ug  -  0)  (2.3.146) 

which  may  also  be  expressed  as 

p(Q*  |  ug  =  0)  =  p{0*)  -  p(Zg,0)a( O*)  (2.3.147) 

because  of  (2.3.59).  This  estimator  is  merely  the  product  of  a  regression  weight — in  this  case  p(Zg,Q)(r(Q*) 
because  Zg  has  a  standard  deviation  of  unity — and  the  value  of  the  density  at  yg  in  the  standard  normal  distribution, 
c Kyg ),  divided  by  the  unconditional  probability  of  an  incorrect  answer  to  item  g,Qg ,  subtracted  from  the  mean 
of  e*,/i(e*). 

The  expressions  for  the  least  squares  estimators  of  0*  provided  by  (2.3.138)  and  (2.3.139)  and  by 
(2.3. 146)  and  (2.3. 147)  will  have  further  use  in  later  derivations  in  Chapter  5.  Notice  that  the  estimators  provided 
by  (2.3.108)  and  (2.3.116)  may  be  viewed  as  resulting  from  (2.3.139)  and  (2.3.147),  respectively,  under  the 
assumption  that  /x(0*)  is  zero  and  0^(0*)  is  unity.  Since  the  specific  case  can  be  directly  obtained  from  the 
general  case  through  this  simplifying  assumption,  later  developments  in  ability  estimation  will  be  primarily 
concerned  with  the  general  case.  Earlier  it  was  noted  that  the  general  case  has  the  more  interesting  practical 
implications.  In  Chapter  5,  the  sequential  estimation  of  0*  given  the  free-response  items  constituting  a  tailored 
test  will  become  of  concern. 
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3.  EFFECTS  OF  BINARY  SCORING:  A  SUBMODEL 
FOR  MULTIPLE-CHOICE  ITEMS 


3.1  The  Three-Parameter  Normal  Ogive  Submodel 

Consider  the  situation  where  the  possible  answers  to  a  question  posed  by  an  item  have  been  assigned 
ordered  scores  on  the  basis  of  their  relative  correctness.  Suppose  that  it  is  then  possible  to  assign  recognition 
scores  to  individuals.  Let  this  score  for  a  given  individual  be  defined  as  the  value  of  the  most  correct  answer 
that  would  be  recognized  as  correct  on  the  given  occasion.  For  p  items  designed  to  measure  the  same  ability, 
the  ordering  of  scores  for  the  possible  answers  generates  p  continua  of  item  scores.  When  the  frequencies  of 
individuals  with  identical  recognition  scores  are  associated  with  their  corresponding  ordered  scores,  random 
variables  such  as  the  Zg  of  Chapter  1  are  the  result. 

In  the  case  of  a  multiple-choice  item,  one  of  its  alternatives  serves  as  a  correct  answer.  The  score  assigned 
to  the  answer  chosen  for  the  correct  alternative  is  then  yg,  the  point  of  dichotomization  on  the  random  variable 
Zr  As  a  result,  individuals  with  recognition  scores  equal  to  or  greater  than  yg,  that  is  those  who  recognize  the 
correct  alternative  as  well  as  better  answers  than  the  correct  alternative  as  correct,  receive  a  binary  score  of  one. 
The  remaining  individuals  then  guess.  Successful  guessing  on  the  given  item  occurs  at  a  specific  rate,  and  this 
rate  of  success  occurs  at  random  among  those  individuals  who  are  unable  to  recognize  the  correct  alternative  on 
the  given  occasion.  Individuals  who  guess  successfully  also  receive  a  binary  score  of  one ,  while  those  who  do 
not  receive  a  binary  score  of  zero.  Hence,  U'  has  two  possible  realizations: 

ug  =  I  When  £g  ^  yg  (correct  alternative  recognized)  or 

CH  <  yg  (correct  alternative  not  recognized:  guessing  successful) 

u’H  =  0  When  (g  <  yg  (correct  alternative  not  recognized:  guessing  unsuccessful) 

where  the  prime  on  Ug  indicates  that  item  g,  a  multiple-choice  item,  is  influenced  by  guessing.  Most  of  the 
expressions  in  this  section  will  have  their  counterparts  in  the  two-parameter  normal  ogive  submodel.  As  in  the 
instance  of  ug,  some  of  these  expressions  will  be  directly  influenced  by  guessing.  To  maintain  clarity  in  the 
discussion,  the  expressions  influenced  by  guessing  will  be  denoted  through  the  use  of  a  prime.  Unprimed 
expressions  will  be  those  uninfluenced  by  guessing  that  are  identically  defined  under  both  submodels. 

The  rate  of  successful  guessing  on  item  g  is  not  solely  determined  by  the  number  of  its  alternatives.  For 
instance,  the  relative  attractiveness  of  the  alternatives  will  have  some  influence.  An  alternative  can  appear  more 
or  less  attractive  than  others  to  those  unable  to  recognize  the  correct  answer.  The  condition  is  permissible  because 
this  submodel  does  not  assume  that  guessing  occurs  at  random  with  respect  to  the  item  alternatives  when  the 
correct  alternative  is  not  recognized.  The  requirement  that  individuals  respond  at  random  to  the  item  alternatives 
when  the  correct  alternative  is  not  recognized  goes  beyond  the  statement  of  this  submodel.  The  submodel  merely 
posits  that  obtaining  a  correct  answer  to  item  g  through  guessing  occurs  at  random  at  a  specifiable  rate  cg  for 
the  subpopulation  on  the  subinterval  of  Zg  where  £g  is  less  than  y 

The  proposition  that  extant  multiple-choice  items  contain  alternatives  of  equal  attractiveness — a  necessary 
condition  to  justify  the  assumption  that  guessing  occurs  at  random  with  respect  to  the  item  alternatives — is  readily 
disconfirmed  with  empirical  data. 

In  conventional  item  analyses,  one  finds  that  the  proportions  responding  to  the  incorrect  alternatives  of 
each  multiple-choice  item  g  are  not  always — as  required  by  this  proposition — equal.  The  typical  observation  is 
that  of  the  inequality  of  these  proportions. 

Let  cg  represent  the  rate  of  successful  guessing  on  item  g  when  £g  is  less  than  yg.  As  a  consequence,  cg, 
as  will  be  seen  in  (3.1 . 17),  is  defined  as,  or  fixed  by,  the  lower  asymptote  of  the  item  characteristic  curve.  Since 
cg  is  fixed,  Zg  then  completely  determines  the  binary  random  variable  Ug.  Again  the  Zg  are  affected  by  measurement 
error.  Thus  the  U'g  are  likewise  affected.  The  transformation  of  Zg  into  U'g  again  results  in  a  transformation  of 
the  true  score  metric.  A  new  true  score  variable  Tg  and  a  new  error  score  variable  Eg  are  again  implicitly  produced 
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by  the  transformation  of  Zg  into  Ug.  For  any  individual  i  on  occasion  o,t'gj  represents  the  individual’s  true  score 
on  binary  item  g  while  egio  represents  the  individual’s  error  score  on  binary  item  g.  True  score  is  defined  as  the 
expected  value  of  the  u'gio  for  individual  i  over  testing  occasions,  that  is, 

tgi  =  %0  Ugio  (3.1.1) 

and  error  score  is  defined  as 

^gio  Mgio  ~  tgi'  (3.1.2) 

Given  the  definition  of  true  score  presented  in  (3.1.1),  Tg  is  the  least  squares  estimate  of  U'g  given  0. 
All  individuals  with  ability  equal  to  that  of  individual  i,6=  6h  have  identical  true  scores, 

=  Wg\  0  =  0,),  (3.1.3) 

which  is  a  realization  of  the  random  variable 

Tg  =  %{Ug  |  0).  (3.1.4) 

The  expectation  relationship  in  (3. 1.4)  defines  T'g  as  the  least  squares  regression  function  of  Ug  onto  0. 

For  a  multiple-choice  item  g,  the  functional  form  of  the  regression  of  Ug  onto  O  is  the  item  characteristic 
curve  for  the  three-parameter  normal  ogive  of  latent  trait  theory  (Lord  &  Novick,  1968).  In  this  case,  the  expected 
value  of  U'g  given  6  is 

Tg  =  %{Ug  |  d)  =  2  ugk  Pr (ugk  |  0) 

u&k  =  <> 

=  (0)  Pr («'  =  0  I  0)  +  (1)  Pr(Ms  =  1  |  0) 

=  Pr  {u'g  =  1  |  0)  (3.1.5) 

where  the  probability  of  a  correct  answer  given  0  has  changed  in  relation  to  the  two-parameter  case.  Using  the 
definitions  of  lg{0)  and  yg(0)  of  (2. 1.10)  and  (2.1.11),  it  is  found  that 

Pr(M'  =  1  |  0)  =  Pr [Zx(8)  ^  ys(0)]  +  c*  PrlZ^O)  <  y^(0)]  (3.1.6) 

which  flows  from  the  discussion  of  the  manner  in  which  Zg  determines  f/;,.  The  hypothetical  relation  between 
Zg  and  U'g  is  portrayed  in  Figure  3.1.1,  where  the  shaded  areas  on  each  conditional  distribution,  Zg{6),  represent 
the  terms  in  the  rightmost  equality  of  (3.1.6).  Since  the  area  under  the  standard  normal  distribution  is  unity,  it 
is  to  be  noted  that  due  to  (2.1.16) 

Pr[Zg(6)  <  jg(6)]  =  1  -  Pr [Zg(d)  3*  yg(0)],  (3.1.7) 

which  allows  some  simplification  in  (3.1.6).  The  substitution  of  (3.1.7)  into  (3.1.6)  yields 

Pr^'  =  1  |  6)  =  Pr [Zg(0)  ^  7s(0)]  +  c,  {1  -  Pr[Z,(0)  ^  7,(0)]}  (3.1,8) 

or,  after  consulting  the  identities  provided  by  (2.1.16)  and  (2. 1 .20)  leads  to 

Pr(«'  =  1  |  6)  =  Pg(6)  +  cg[l  -  Pg(6)]  =  Pg(6)  +  CgQg(6)  (3.1.9) 

which  can  be  compared  to  its  two-parameter  counterpart  for  free-response  items.  This  expected  value  is  designated 
as  P'g(0)  in  order  to  distinguish  it  from  its  corresponding  term  in  the  two-parameter  submodel  and  acknowledge 
the  contribution  of  guessing  as  indexed  by  the  rightmost  terms  in  each  of  the  two  equalities  on  the  right  side  of 
(3.1.9).  This  designation  yields 

Pg(6)  =  Pg(6)  +  cgl  1  -  Pg(6)\  =  Pg(0)  +  CgQg{0)  (3.1.10) 

which  indicates  that  the  probability  of  obtaining  a  correct  answer  on  item  g  is  equal  to  the  probability  of  recognizing 
the  correct  alternative,  Pg(0),  plus  guessing  correctly  at  a  rate,  cg,  when  with  probability,  [1  -P  (0)]  or  Qg(0), 
the  correct  answer  is  not  recognized.  For  computational  convenience,  (3.1.10)  is  usually  rearranged  as 

Pg(0)  =  cg  +  (I  -  Cg)Pg(6).  (3.1.11) 
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it g  —  0  (Unshaded  Ar«J 


1  (Shaded  Area) 


Figure  3.1.1.  Hypothetical  relations  among  the  item  continuum  Zg,  the  multiple-choice,  binary  item  U'g,  and 
the  latent  trait  0, 

Substitutions  from  (2.1.18)  into  (3.1.11)  now  allow  one  to  write 

P'g(d)  =  cg  +  (1  -  cg)  <p[-yg(d)]  =  cg  +  (1  -  cg)  <P[ag(d  -  bg)]  (3.1.12) 

where  <£>[*]  is  again  by  definition  the  cumulative  normal  distribution  function  as  expressed  in  (2.1.18). 

Note  that  the  probability  of  answering  a  multiple-choice  item  g  incorrectly  given  a  fixed  value  of  ability, 
Qg{6 ),  is  provided  by 

(yg(V) 

Qg(0)  =  (1  -  cx)  Pr[Zs(0)  <  7,(6)]  =  (1  -  cg)  J  _  (2ir)“  5  exp{- .5 [£g(d)]2}  d£g(e)  (3.1.13) 
which  after  substitutions  from  (2.1.20)  yields 

Qg(6)  =  y  -  cg)  Qg(6)  =  (1  -  cg)  <P[ygm  =  (1  -  cg)  <P[-ag(d-b8)]9  (3.1.14) 

The  conditional  probability,  Qg(6 ),  provided  in  (3.1.13)  and  (3.1.14)  is  the  complement  of  the  conditional 
probability,  P'g(6)y  provided  in  (3.1.10)  through  (3.1.12),  because 

F’(0)  +  Qg(6)  =  1  (3.1.15) 

which  may  be  verified  through  the  substitution  of  the  second  equality  in  (3.1.14)  and  the  rightmost  equality  in 
(3.1.10)  into  (3.1.15).  After  these  substitutions  are  made,  one  may  write 

Pg(0)  +  Qg{0)  =  1  (3.1.16) 

a  relationship  established  in  connection  with  (2.1.20). 

The  Parameters 

Equation  (3.110)  represents  an  expression  for  the  item  characteristic  curve,  the  item  true  score  function 
Tg1  and  the  regression  of  a  multiple-choice,  binary  item  Ug  onto  0.  This  functional  form  provides  the  probability 
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of  a  correct  answer  to  item  g  as  a  function  of  O.  The  parameters  of  this  expression  are  ag,  bgy  and  cgy  where 
ag  and  bg  are  defined  in  (2.1.12)  and  (2.1.13)  and  cg  is  the  coefficient  of  guessing,  that  is,  the  rate  at  which 
successful  guessing  occurs  among  individuals  who  do  not  recognize  the  correct  alternative. 

Figure  2.1.1  for  a  free-response  item  g  may  be  compared  with  Figure  3.1.1  for  a  multiple-choice  item 
g •  Notice  that  the  dichotomization  of  the  Zg(0')  and  Zg(6")  at  yg(ff)  and  yg(ff '),  respectively,  occurs  in  both 
figures.  Actually,  the  shaded  areas  below  yg(d')  and  yg(0')  in  Figure  3.1  1  for  the  multiple-choice  case  represent 
the  only  departure  from  a  dichotomization  of  the  conditional  distributions  in  determining  correct  and  incorrect 
answers.  Thus,  there  is  a  similarity  between  the  two-  and  three-parameter  submodels.  This  similarity  is  illustrated 
in  Figure  3.1.2,  which  presents  the  item  characteristic  curve  (solid  function)  for  a  multiple-choice  item  g.  Also, 
in  the  figure,  a  dashed  function  is  presented.  This  dashed  function  is  actually  a  two-parameter  curve  representing 
the  probability  that  the  correct  alternative  will  be  recognized  given  9.  The  solid  regression  function,  Pg(8)y  can 
be  viewed  as  the  curve  that  connects  the  conditional  proportions  that  are  the  output  of  (3.1.10)  at  each  level  of 
O.  The  dashed  function  is  obtained  from  the  leftmost  term  in  the  rightmost  equality  in  (3.1.10),  namely,  P  (9) y 
where  Pg{8)  is  based,  as  in  the  free-response  case,  on  the  parameters  ag  and  bg.  Thus,  the  earlier  discussion  of 
these  parameters  is  still  fully  pertinent.  What  is  new  is  the  contribution  of  guessing,  which  can  be  obtained  from 
the  rightmost  term  on  the  right  hand  side  of  (3. 1 . 10),  namely,  the  product  cgQg(0 ).  As  pictured  in  Figure  3. 1 .2, 
this  contribution  is  represented  by  the  vertical  distance  between  the  solid  and  dashed  functions  for  a  given  value 
9.  Notice  that  the  coefficient  of  guessing,  cgy  is  constant  with  respect  to  the  random  variable  0,  but  that  the 
contribution  of  guessing  diminishes  as  9  increases.  Guessing  is  only  invoked  when  the  correct  alternative  is  not 
recognized.  Since  the  probability  of  recognizing  the  correct  alternative  is  an  increasing  function  of  latent  ability, 
the  product  of  its  complement  and  a  constant  is  a  diminishing  function  of  latent  ability.  Notice  in  Figure  3.1.2 
that  cg  is  the  lower  asymptote  of  the  item  characteristic  curve  as  measured  on  the  ordinate.  More  formally,  then, 
cg  is  defined  as 


cg  =  lim  Pg(9)y 
e  ->  -* 

the  limiting  value  (lower  asymptote)  of  Pg{9)  as  9  approaches  negative  infinity. 


(3.1.17) 


8(U'g\d)  =  P’g(0) 


r 

g 


Figure  3.1.2.  The  item  characteristic  curve  or  the  regression  (solid  function)  of  a  binary,  multiple-choice  item 
Ug  on  the  latent  trait  <9. 
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At  this  juncture,  some  numerical  examples  are  helpful.  These  examples  will  highlight  the  relationships 
between  Figure  3.1.1  and  Figure  3.1.2  for  item  g  given  its  parameters. 

Example  3. LI.  The  slope  of  the  regression  of  Zg  onto  0  in  Figure  3.1.1  is  .86.  This 
value  is  also  p(Zg,0)  because  both  Zg  and  O  are  depicted  as  distributed  with  a  mean  of  zero  and 
a  variance  of  unity.  Thus  item  discriminatory  power,  ag ,  as  given  by  (2.1.12)  is  1.6853.  In  Figure 
3.1.1,  the  ordinate  and  abscissa  are  both  portrayed  for  the  range  of  values  from  —3.0  to  +3.0. 

The  projection  of  the  point  of  intersection  of  the  line  segment  extending  horizontally  through  y^ 
and  the  line  of  regression,  %{0  |  ^),  occurs  at  a  value  of  1.1628.  Thus,  bg  is  equal  to  1.1628. 

The  distributions  of  Zg  given  0  are  symmetric  about  their  means  which  coincide  with  the  line  of 
regression,  %{Zg  \  0).  Hence,  at  this  intersection  where  0  equals  bg ,  PL(bg ),  the  probability  of 
recognizing  the  correct  alternative  to  item  g ,  is  .5.  This  probability  may  be  ascertained  by  examining 
the  dashed  function  in  Figure  3.1.2.  The  probability  of  a  correct  answer  to  this  multiple-choice 
item  g  at  0  equal  to  bg,  P'g{bg),  is  .555  as  may  be  judged  through  the  examination  of  the  solid 
function  in  Figure  3.1.2.  The  lower  asymptote  of  the  item  characteristic  curve  for  this  item  g ,  as 
may  be  verified  by  inspection  of  Figure  3.1.2,  is  .11.  Since  cg  is  .11  and  Pg{0)  is  .50  at  6  equal 
to  bg ,  Pg(bg)  as  evaluated  by  (3.1.11)  is  .555. 

Example  3.1.2  In  Figures  3.1.1  and  3.1.2,  0f  has  the  value  of  —1.10.  When  y g(0)  of 
(2.1.15)  is  evaluated  at  0f ,  y g(0')  is  found  to  equal  3.8135.  Note  that  the  standardized  conditional 
distribution  of  Zg(0 '),  as  well  as  that  of  Zg(0'),  is  displayed  in  Figure  3.1.2  as  ranging  in  value 
from  —3.0  to  +3  0.  This  range  of  values  accounts  for  .9973  of  the  probability  or  area  under  the 
curve.  Thus,  the  area  above  y(0')  on  Zg(6f),  the  standardized  conditional  distribution  of  Zg  given 
0',  is  provided  by  (2. 1.18)  as  .00.  This  value  of  Pg(0f)  is  indicated  by  the  relationship  between 
y g(0f),  the  point  of  dichotomization  on  Zg(0 '),  and  Zg(6r).  The  probability  of  recognizing  the 
correct  alternative  to  item  g  given  0'  is  negligible.  However,  the  probability  of  obtaining  a  correct 
answer  to  item  g  given  0',  Pg(0r),  is  not  negligible.  Since  cg  equals  .11  and  P  {&)  equals  .00, 

Pg(0 ),  when  evaluated  by  (3.1.11)  at  0' ,  is  found  to  be  .11.  This  probability  is  represented  in 
Figure  3. 1.2  by  the  shaded  area  in  the  standardized  conditional  distribution  of  Zg(0').  This  shaded 
area  occurs  in  the  effective  range  for  Zg(0')  which  is  below  the  point  of  dichotomization  on  Zg(0'), 

y ’,(*)■ 

The  value  ot  1 1  for  Pg(0f)  represents  the  probability  ol  obtaining  a  correct  answer  to  item 
g  given  a  standard  ability  score  of  —  1 . 10.  Thus,  a  point  may  be  placed  in  Figure  3.1.2  with  the 
coordinates  of  .  1 1  on  the  ordinate,  Pg(6 ),  and  0',  —  1.10,  on  the  abscissa  O. 

Example  3.1.3.  In  Figures  3.1.1  and  3.1.2,  0"  has  the  value  of  1.00.  When  y ^(0)  of 
(2.1.15)  is  evaluated  at  0' ,  it  is  found  that  yg(0")  equals  .2744.  The  area  above  yg(0")  on  Zg(9”), 
the  standardized  conditional  distribution  of  Zg  given  0" ,  is  provided  by  (2.1.18)  as  .3919  This 
value  of  Pg(0 "),  the  probability  of  recognizing  the  correct  alternative  to  item  g ,  is  portrayed  in 
Figure  3.1.1  as  the  shaded  area  in  the  standardized  conditional  distribution  of  Zg(0")  above  the 
point  of  dichotomization  yg(0").  The  probability  of  obtaining  a  correct  answer  to  item  g  given  0' 
is  obtained  from  (3.1.11).  Given  cg  equal  to  .11  and  yg(0")  equal  to  .3919,  an  evaluation  of 
(3. 1.11)  yields  .4588  for  this  probability,  Pg(0”).  This  probability  is  represented  in  Figure  3.1.1 
by  the  shaded  area  in  the  standardized  conditional  distribution  of  Zg{9")  which  occurs  both  above 
and  below  the  point  of  dichotomization,  yg{9").  In  this  context,  yg(0)  might  be  referred  to  as  the 
threshold  of  recognition  given  0.  As  discussed  earlier,  obtaining  the  correct  answer  to  multiple- 
choice  item  g,  however,  is  not  the  same  as  recognizing  the  correct  alternative.  The  selection  of 
the  correct  alternative  or  obtaining  a  correct  answer  to  multiple-choice  item  g  occurs  through 
successful  guessing  when  the  threshold  of  recognition  on  Zg{0)  has  not  been  reached. 

The  value  of  .4588  for  P'g(0n )  represents  the  probability  of  obtaining  a  correct  answer  to 
item  g  given  a  standard  ability  score  of  1.00.  Thus,  a  point  may  be  placed  in  Figure  3.1.2  with 
the  coordinates  of  .4588  on  the  ordinate,  Pg(0"),  and  0 ",  1.00,  on  the  abscissa  0. 

The  item  characteristic  curve  of  Figure  3.1.2  can  be  constructed  by  repeating  the  numerical  process 
illustrated  in  Examples  3.1.2  and  3.1.3  for  a  sufficient  number  of  points  equally  spaced  on  the  abscissa,  0.  It 
is  useful  to  be  able  to  examine  the  item  characteristic  curves  for  various  items  given  their  parameters.  The 
characteristic  curve  for  a  multiple-choice  item  g,  given  its  parameters,  can  be  conveniently  produced  for  this 
purpose  through  the  aid  of  a  plotter  and  the  formulation  as  illustrated  in  Examples  3.1.2  and  3.1.3  for  the 
arbitrary  points  0 '  and  0 ". 
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3.2.  Further  Consequences  of  the  Submodel 


Given  the  basic  model  from  which  the  three-parameter  normal  ogive  submodel  is  derived,  it  is  known 
that  the  joint  distribution  of  Zg  and  0  is  still  bivariate  normal.  This  condition  of  bivariate  normality  obtains  even 
though  the  phenomenon  of  success  due  to  guessing  on  multiple-choice  items  has  been  accommodated  in  this 
submodel.  As  in  the  case  of  the  two-parameter  submodel,  this  condition  facilitates  the  derivations  of  convenient 
mathematical  expressions.  Again,  the  derivations  for  these  expressions  follow  from  defining  relationships  within 
the  bivariate  normal  distribution.  In  this  section  these  expressions  will  be  presented  and  numerically  illustrated 
using  multiple-choice  item  g  as  portrayed  in  Figure  3.1.1  for  illustrative  purposes.  Given  the  three-parameter 
normal  ogive  submodel,  convenient  expressions  will  be  presented  for: 

1 .  The  unconditional  probabilities  for  the  realizations  of  Ug. 

(a)  The  probability  of  a  correct  answer  to  item  g,  Pr(wJ,  =  1). 

(b)  The  probability  of  an  incorrect  answer  to  item  g,  Pr  (u  g  =  0). 

2.  The  conditional  means  of  Zg  given  the  realizations  of  U'g. 

(a)  The  mean  of  Zg  given  a  correct  answer  to  item  g,  fx(Zr,  |  ug  =  1). 

(b)  The  mean  of  Zg  given  an  incorrect  answer  to  item  g,  fi(Zg  \  u'g  —  0). 

3.  The  conditional  variances  of  Zg  given  the  realizations  of  Ug. 

(a)  The  variance  of  Zg  given  a  correct  answer  to  item  g,  oP-(ZJg  \  u[,  =  1). 

(b)  The  variance  of  Zg  given  an  incorrect  answer  to  item  g,  (r2(Zg  |  ug  —  0). 

4.  The  least  squares  estimators  of  ability  given  the  realizations  of  U'„. 

(a)  Specific  case. 

(1)  The  mean  of  0  given  a  correct  answer  to  item  g,  /x(0  |  it'  =  1). 

(2)  The  mean  of  0  given  an  incorrect  answer  to  item  g,  fx(0  |  —  0). 

(b)  General  Case. 

(1)  The  mean  of  0*  given  a  correct  answer  to  item  g,  /x(0*  |  ug  =  1). 

(2)  The  mean  of  0*  given  an  incorrect  answer  to  item  g,  /x(0*  |  li,  —  0). 

These  expressions  will  be  derived  in  Section  3.3.  For  those  readers  seeking  a  general  understanding,  Section 
3.3  may  be  omitted  without  loss  of  continuity. 

The  Unconditional  Probabilities  for  the  Realizations  of  Ug 

The  binary  random  variable  Ug  can  realize  only  one  of  two  possible  values.  In  the  instance  of  a  correct 
answer  to  a  multiple-choice  item  g,  u'g,  the  realization  of  U'H,  equals  one.  In  the  instance  of  an  incorrect  answer 
to  a  multiple-choice  item  g,  the  realization  of  U'g ,  u'g  equals  zero . 

The  Probability  of  a  Correct  Answer  to  Item  g,  Pr  (u'g  =  1).  This  unconditional  probability  is  designated 
P'g.  Most  commonly,  it  is  known  as  the  p-\ alue  for  multiple-choice  item  g.  A  convenient  expression  for  this 
probability  is 

pr K  =  *)  =  Ph  =  cs  +  (l  -  ps  =  Cg  +  0  “  cg)  <P[-ygl  (3.2.1) 

where  cg  is  the  guessing  coefficient  as  defined  in  (3.1  17)  and  Pg.  which  equals  &[  —  yg\,  is  the  probability  of 
recognizing  the  correct  alternative  to  multiple-choice  item  g  as  given  by  (2.2.1).  Notice  that  y  as  required  in 
an  evaluation  of  (2.2. 1),  is  identically  defined  under  both  the  two-  and  three-parameter  normal  ogive  submodels. 
This  situation  exists  because  yg  as  seen  in  (2.2.2)  is  determined  by  pZg,G)  and  bg ,  both  of  which  are  identically 
defined  under  these  submodels.  The  difference  under  these  submodels  resides  in  the  interpretation  of  the  probability 
Pg.  In  the  previous  context,  this  unconditional  probability  was  that  of  obtaining  a  correct  answer  to  a  free- 
response  item  g.  In  the  present  context,  this  unconditional  probability  represents  that  of  recognizing  the  correct 
alternative  to  a  multiple-choice  item  g. 

Example  3.2.1.  It  is  known  from  Example  3.1.1  that  p(ZgyQ),  the  correlation  between 
the  continuous  variables  Zg  and  0,  is  .86,  and  that  bg9  the  item  difficulty  parameter,  is  1.1628. 

Thus  yg,  the  point  of  dichotomization  on  the  continuous  variable  Zg,  is  found  to  be  1.00  when 
(2.2.2)  is  evaluated.  Hence.  Pg,  the  unconditional  probability  of  recognizing  the  correct  answer 
to  multiple-choice  item  g  as  given  by  (2.2.1),  is  .1587.  Since  Pg  is  .1587  and  cg,  as  determined 
in  Example  3.1.1,  is  .11,  Pg  as  evaluated  by  (3.2.1)  is  .2512.  The  unconditional  probability  P' 
is  that  of  obtaining  a  correct  answer  to  multiple-choice  item  g. 
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The  value  of  Pg,  1587,  represents  the  size  of  the  shaded  area  above  yg  in  the  marginal 
distribution  of  Zg  as  portrayed  along  the  ordinate  in  Figure  3.1.1.  If  yg  is  considered  the  threshold 
of  recognition  on  Zg ,  then  the  size  of  this  shaded  area  represents  the  probability  of  recognizing 
the  correct  alternative  to  multiple-choice  item  g.  The  value  of  P'g9  .2512,  represents  the  size  of 
the  combined  shaded  areas  both  above  and  below  yg  in  the  marginal  distribution  of  Zg  as  depicted 
along  the  ordinate  in  Figure  3.1.1.  The  size  of  these  shaded  areas  represents  the  probability  of 
obtaining  a  correct  answer  to  multiple-choice  item  g. 

Since  obtaining  a  correct  answer  to  multiple-choice  item  g  is  not  fully  determined  by  a  dichotomization 
of  a  normally  distributed  random  variable,  it  is  clearly  a  contradiction  given  this  submodel  to  estimate  p{Zg,Q), 
the  correlation  between  the  continuous  variables  Zg  and  0,  through  the  use  of  the  biserial  correlation.  Furthermore, 
since  obtaining  correct  answers  to  any  two  multiple-choice  items  g  and  h  is  not  fully  determined  by  the  dicho- 
tomizations  of  the  continuous  variables  Zg  and  Zh,  it  is  clearly  a  contradiction  given  this  submodel  to  estimate 
p(Zg,Zh),  the  correlation  between  the  continuous  variables  Zg  and  Zh,  through  the  use  of  the  tetrachoric  correlation. 
The  use  of  the  tetrachoric  correlation  with  multiple-choice  items  in  factor-analytic  studies  is,  unfortunately, 
widespread.  This  practice  is  inapproriate  because  the  submodel  considered  here  has  been  found  to  be  valid  for 
multiple-choice  items  (Urry,  1977). 

The  Probability  of  an  Incorrect  Answer  to  Item  g,  Pr(z^  =  0).  This  unconditional  probability  is  designated 
as  Q'g.  A  convenient  expression  for  this  probability  is 


PrK  =  0)  =  Q'g  =  (1  -  cg)  Qg  =  ( 1  "  cg)  <P[yg],  (3.2.2) 

where  cg  is  the  coefficient  of  guessing  as  defined  in  (3.1.17)  and  Qg,  which  equals  <£[%],  the  probability  of 
not  recognizing  the  correct  alternative  to  multiple-choice  item  g,  is  given  by  (2.2.3).  In  the  context  of  the  two- 
parameter  normal  ogive  submodel,  this  unconditional  probability  was  that  of  obtaining  an  incorrect  answer  to  a 
free-response  item  g.  In  the  present  context,  this  unconditional  probability  is  that  of  not  recognizing  the  correct 
alternative  to  a  multiple-choice  item  g.  Since  the  rate  of  successful  guessing  on  item  g  is  cg1  (1  -  cg)  is  the  rate 
of  unsuccessful  guessing.  Thus,  the  product  of  (1  -  cg)  and  Qg  as  given  in  (3.2.2),  represents  the  probability 
of  not  recognizing  the  correct  alternative  to  multiple-choice  item  and  guessing  incorrectly.  That  is  to  say,  this 
product,  Qg,  represents  the  unconditional  probability  of  an  incorrect  answer  to  a  multiple-choice  item  g. 

Example  3.2.2.  It  is  known  from  Example  3.2. 1  that  yg ,  the  point  of  dichotomization  on 
Zg  for  item  g  of  Figure  3.1.1,  is  1.00.  Hence  Qg,  the  unconditional  probability  of  not  recognizing 
the  correct  alternative  to  multiple-choice  item  g  as  evaluated  with  (2.2.3),  is  .8413.  Since  Qg  is 
.8413  and  cg,  as  determined  in  Example  3.1.1,  is  .1 1,  Qg  as  evaluated  through  the  use  of  (3.2.2) 
is  .7488.  Notice  that  this  value  is  the  complement  of  Pg  or  .2512  as  is  Qg  or  .8413  the  complement 
of  Pg  or  .1587. 

The  value  of  Qg  represents  the  size  of  the  area  both  shaded  and  unshaded  below  yg  in  the 
marginal  distribution  of  Zg  as  portrayed  along  the  ordinate  in  Figure  3.1.1.  The  size  of  this  area 
represents  the  probability  of  being  below  the  threshold  of  recognition  on  the  continuous  variable 
Zg.  The  value  of  Qg  or  .7488,  represents  the  size  of  the  unshaded  area  below  yg  in  the  marginal 
distribution  of  Zg  as  depicted  along  the  ordinate  in  Figure  3.1.1.  This  unconditional  probability 
is  that  of  obtaining  an  incorrect  answer  to  multiple-choice  item  g,  that  is  to  say,  the  probability 
of  not  recognizing  the  correct  alternative  to  multiple-choice  item  g  and  guessing  unsuccessfully. 

If  yg  were  actually  a  cut  score  on  an  observed  continuous  variable  Zg ,  and  that  subpopulation  normally 
rejected  were  also  selected  at  random  at  a  rate  cg ,  then  Pg  would  be  the  selection  ratio  or  the  probability  of  being 
selected,  and  Qg  would  be  the  probability  of  being  rejected.  In  this  submodel,  there  also  exists  an  analogous 
relationship  between  the  binary  scores  on  a  multiple-choice  item  g,  either  a  one  or  a  zero ,  and  this  particular 
method  of  selection  or  rejection  on  an  observed  continuous  variable,  This  analogy,  as  well  as  the  one  drawn 
earlier  with  respect  to  the  two-parameter  normal  ogive  submodel,  provides  the  basis  for  later  developments  in 
Chapter  5.  In  that  chapter  the  tailoring  algorithms  will  be  derived  through  the  use  of  selection  theory.  This  theory 
is  applicable  when  the  method  of  selection  or  rejection  can  be  specified. 
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The  Conditional  Means  of  Zg  Given  the  Realizations  of  Ufg 

The  mean  of  Zg  can  assume  one  of  two  possible  values.  When  multiple-choice  item  g  is  answered 
correctly,  ug,  the  realization  of  the  binary  random  variable  Ug,  equals  one.  Thus  the  mean  of  Zg  given  a  correct 
answer  to  multiple-choice  item  g  is  designated  p(Zg  \  ug  =  1).  When  multiple-choice  item  g  is  answered 
incorrectly,  ug ,  the  realization  of  the  binary  random  variable  U’g ,  equals  zero.  Thus  the  mean  of  Zg  given  an 
incorrect  answer  to  multiple-choice  item  g  is  designated  p(Zg  \  ug  =  0). 

The  Mean  of  Zg  Given  a  Correct  Answer  to  Item  g ,  p(Zg  \  ug  =  1).  A  convenient  expression  for  this 
mean  is  given  by 

i  <f>(%) 

fliZg  |  =  I)  =  (1  -  cg)  ,  (3.2.3) 

where  c ^  is  the  coefficient  of  guessing  as  defined  in  (3.1.17);  4>(yg)  is  the  density  in  the  standard  normal 
distribution  evaluated  at  yg ,  the  point  of  dichotomization  on  the  continuous  variable  Zg ,  as  provided  by  (2.2.5); 
and  Pg  is  the  unconditional  probability  of  obtaining  a  correct  answer  to  multiple-choice  item  g  as  given  by 
(3.2.1). 


Example  3.2.3.  In  Example  3.2.1  it  was  found  that  yg  and  Pg  for  item  g  as  depicted  in 
Figure  3.1.1  were  1.00  and  .2512,  respectively.  Thus  4>(yg)  as  evaluated  in  (2.2.5)  is  .2420. 

Since  cg ,  as  determined  in  Example  3.1.1,  is  .11,  4>(yg)  is  .2420,  and  Pg  is  .2512,  an  evaluation 
of  p(Zg  |  ug  —  1)  through  use  of  (3.2.3)  with  these  values  yields  .8574  as  the  mean  of  Zg  given 
a  correct  answer  to  multiple-choice  item  g. 

This  value  represents  the  mean  of  the  combined  shaded  areas  in  the  marginal  distribution 
of  Zg  as  portrayed  in  Figure  3.1.1  along  the  ordinate.  Remember  this  distribution  is  displayed  for 
the  interval  on  Zg  ranging  from  —3.0  to  +3.0. 

The  Mean  of  Zg  Given  an  Incorrect  Answer  to  Item  g,  p(Z  \  it',  =  0).  A  convenient  expression  for  this 
mean  is  provided  by 

d>(  y  ) 

MtZ*  |  <  =  0)  =  -  -f~,  (3.2.4) 

Us 

where  4>{yg)  is  the  density  in  the  standard  normal  distribution  evaluated  at  yg ,  the  point  of  dichotomization  on 
the  continuous  variable  Zg,  as  provided  by  (2.2.5);  and  Qg  is  the  unconditional  probability  of  not  recognizing 
the  correct  alternative  to  multiple-choice  item  g  as  given  by  (2.2.3).  Notice  that  this  mean  is  obtained  through 
a  formula  which  is  algebraically  equivalent  to  that  of  (2.2.6)  for  its  counterpart  under  the  two-parameter  normal 
ogive  submodel.  This  algebraic  equivalence  obtains  because  success  due  to  guessing  in  the  three-parameter  case 
is  assumed  to  occur  at  random  at  a  rate  of  cg  on  the  interval  of  Zg  from  negative  infinity  to  yg. 

Example  3.2.4.  For  the  item  portrayed  in  Figure  3.1.1,  it  was  found  in  Example  3.2.3 
that  4>(yg)  equalled  .2420,  and  in  Example  3.2.2  that  Qg  equalled  .8413.  When  (3.2.4)  is  evaluated 
for  these  values  of  (f>(yg)  and  Qg ,  it  is  known  that  the  mean  of  Zg  for  the  subpopulation  obtaining 
an  incorrect  answer  to  multiple-choice  item  g,  p (Zg  |  ug  =  0),  is  -  .2877.  This  value,  —  .2877, 
is  the  mean  of  Zg  for  the  subpopulation  represented  by  the  unshaded  portion  in  the  marginal 
distribution  of  Zg  as  portrayed  along  the  ordinate  in  Figure  3.1.1. 

If  yg  were  actually  a  cut  score  on  an  observed  continuous  variable  Zg  and  complete  selection  occurred 
when  (g  was  equal  to  or  greater  than  yg  and  random  selection  occurred  at  a  rate  cg  when  was  less  than  yg, 
then  p(Zg  |  Ug  =  1)  would  be  the  mean  of  Zg  for  the  subpopulation  explicitly  selected  on  the  continuous  variable 
Zg.  Accordingly,  p{Zg  \  ug  =  0)  would  then  be  the  mean  of  Zg  for  the  subpopulation  not  selected,  that  is,  the 
subpopulation  explicitly  rejected  on  the  continuous  variable  Zg. 

The  Conditional  Variances  of  Zg  Given  the  Realizations  of  U'g 

These  variances  of  Zg  can  assume  two  possible  values.  When  multiple-choice  item  g  is  answered  correctly, 
the  realization  of  the  binary  random  variable  U'g,  u'g,  is  one.  Hence  the  variance  of  Zg  given  a  correct  answer 
to  a  multiple-choice  item  g  is  designated  as  cr(Zs  |  u'g  =  1).  When  multiple-choice  item  g  is  answered  incorrectly. 
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u'g,  the  realization  of  the  binary  random  variable  U'g,  is  zero.  Hence  the  variance  of  Zr  given  an  incorrect  answer 
to  multiple-choice  item  g  is  designated  as  cr 2(Zg  \  w'  =  0). 

The  Variance  of  Zg  Given  a  Correct  Answer  to  Item  g,  cP-{Zg  |  u'g  =  1).  A  convenient  expression  for 
this  variance  is  provided  by 


(^(Zg  |  u'g  =  1)  = 


(l  -  Cg)  j>(70 


(1 


c*)  <kv 

P' 

r  g 


(3.2.5) 


where  cg,  the  coefficient  of  guessing  for  item  g,  is  defined  by  (3.1.17);  yK,  the  point  of  dichotomization  on  the 
continuous  variable  Zg,  is  provided  by  (2.2.2);  <b{yg),  the  density  in  the  standard  normal  distribution  evaluated 
at  yg,  is  given  by  (2.2.5);  and  P'g,  the  unconditional  probability  of  a  correct  answer  to  multiple-choice  item  g, 
is  provided  by  (3.2.1). 


Example  3.2.5.  From  Example  3.2.1  it  is  known  that  cg  is  .11,  yg  is  1.00,  and  P'  is  .2512 
for  item  g  as  depicted  in  Figure  3.1.1.  It  is  also  known  for  this  item  from  Example  3.2.3  that 
<Myg)  is  -2420.  Given  these  values  for  cg,  yg,  P'g,  and  <j>(yg),  an  evaluation  of  (3.2.5)  yields 
1.1223  as  (^{Zg  |  u'g  =  1),  the  variance  of  Zg  given  a  correct  answer  to  this  item  g.  Thus, 
I  u'g  =  1).  the  standard  deviation  of  Zg  given  a  correct  answer  to  this  item  g,  is  1.0594. 
The  value  1.0594  is  the  standard  deviation  for  the  subpopulation  represented  by  the  shaded  area 
in  the  marginal  distribution  of  Zg  as  portrayed  along  the  ordinate  in  Figure  3.1.1 


The  Variance  of  Zg  Given  an  Incorrect  Answer  to  Item  g,  cr(Zg  \  u'g  =  0).  A  convenient  expression  for 
thjis  variance  is  given  by 


cEiZg  |  u'g  =  0)  = 


4>(yx)  <Kvg) 

Q*  L  Qg 


(3.2.6) 


where  yg,  the  point  of  dichotomization  on  the  continuous  variable  Zg,  is  given  by  (2.2.2);  4>(y,),  the  density 
in  the  standard  normal  distribution  evaluated  at  yg,  is  defined  by  (2.2.5);  and  Qg,  the  probability  of  not  recognizing 
the  correct  alternative  to  multiple-choice  item  g,  is  provided  by  (2.2.3). 


Example  3.2.6.  It  is  known  from  Example  3.2  I  that  yg  is  1.00  for  item  g  as  depicted  in 
Figure  3. 1  1 .  Also,  from  Example  3.2.2,  it  is  known  that  Qg  is  .8413;  and  from  Example  3.2.3 
it  is  known  that  </>(yg)  equals  .2420  for  this  item  g.  When  (3.2.6)  is  evaluated  with  these  values 
for  7k .  Qg,  and  4>(yg),  eP-{Zg  |  u'g  =  0),  the  variance  of  Zg  given  an  incorrect  answer  to  this  item 
g,  is  .6296.  Thus,  cr(Zg  |  u'g  =  0),  the  standard  deviation  of  Zg  given  an  incorrect  answer  to  this 
item  g,  is  .7935.  The  value  .7935  is  the  standard  deviation  for  the  subpopulation  represented  by 
the  unshaded  portion  of  the  marginal  distribution  of  Zg  as  portrayed  along  the  ordinate  in  Figure 

Notice  that  this  standard  deviation  is  obtained  through  a  formula  that  is  equivalent  to  the 
square  root  of  (2.2.8),  its  counterpart  under  the  two-parameter  normal  ogive  submodel.  This 
algebraic  equivalence  holds  because  the  subpopulation  obtaining  an  incorrect  answer  to  a  multiple- 
choice  item  g  is  assumed  to  result  from  a  random  depletion  of  the  subpopulation  on  the  interval 
from  negative  infinity  to  yg  on  the  continuous  variable  Zg.  In  the  submodel  for  free-response  items 
no  depletion  is  assumed  for  the  subpopulation  on  this  interval.  Since  the  depletion  is  random  when 
it  occurs,  the  standard  deviation  given  an  incorrect  answer  to  item  g  is  invariant  with  respect  to 
these  submodels  where  guessing  is  either  accommodated  or  not  accommodated. 


Least  Squares  Estimators  of  Ability  Given  the  Realizations  of  Ug 

The  specific  and  general  cases  are  considered.  In  the  specific  case,  ability,  0,  has  a  mean.  / x(0 ),  of 
zero  and  a  variance,  o2(0),  of  unity.  In  the  general  case,  ability,  0*,  has  a  mean,  p(0*),  and  a  variance, 
0^(0*),  that  are  prescribed  by  the  practitioner  for  convenience  in  applications. 

Specific  case.  In  this  case,  the  estimators  of  ability,  0,  depend  on  the  realizations  of  the  binary  random 
variable  U'g  or  the  correctness  or  incorrectness  of  the  answer  to  multiple-choice  item  g.  When  the  answer  is 
correct,  the  estimator  of  ability  is  the  mean  of  0  for  the  subpopulation  that  would  obtain  a  correct  answer  on 
item  g.  When  the  answer  is  incorrect,  the  estimator  of  ability,  0,  is  the  mean  of  0  for  the  subpopulation  that 
would  obtain  an  incorrect  answer  on  item  g. 
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Specific  Case:  The  Mean  of  0  Given  a  Correct  Answer  to  Item  g,  fi(0  \  u'g  =  1).  This  estimator  is  a 
least  squares  estimator  because  this  mean  provides  that  value  of  O  about  which  the  sum  of  squared  discrepancies 
is  minimized  for  the  variable  of  ability  given  a  correct  answer  to  a  multiple-choice  item  g.  A  convenient  expression 
for  this  estimator  of  ability  is  provided  by 

d>(y  ) 

li(0  |  «;  =  1)  =  p(Zg,0)  (1  -  cg)  (3.2.7) 

*g 

where  p(Zg,0),  the  correlation  between  the  continuous  variables  Zg  and  O ,  is  known  when  ag ,  the  item  parameter 
of  discriminatory  power,  is  known  through  the  use  of  (2.2.10);  cg9  the  coefficient  of  guessing  for  item  g,  is 
defined  by  (3.1.17);  yg9  the  point  of  dichotomization  on  the  continuous  variable  Zg9  is  known  when  p(Zg90) 
and  bg9  the  item  parameter  of  difficulty,  are  known  through  the  use  of  (2.2.2);  <£( yg),  the  density  in  the  standard 
normal  distribution  evaluated  at  yg,  is  defined  by  (2.2.5);  and  Pg ,  the  unconditional  probability  of  a  correct 
answer  to  a  multiple-choice  item  g,  is  given  by  (3.2.1). 

Example  3.2.7.  In  Example  3.1.1,  it  was  found  for  item  g  as  depicted  in  Figure  3.1.1 
that  the  parameter  of  discriminatory  power  for  this  item  is  1.6853.  When  (2.2.10)  is  evaluated 
for  this  value  of  ag9  p(Zg90)  is  found  to  be  .86,  which  was  the  value  obtained  earlier  through  the 
inspection  of  Figure  3.1.1  in  Example  3.1.1  In  this  example,  cg  was  determined  to  be  .11.  In 
Example  3.2. 1 ,  yg  and  Pg  were  found  to  be  1 .00  and  .2512,  respectively;  and  in  Example  3.2.3, 

4>(yg)  was  determined  as  .2420.  With  these  values  for  p(Zg90)9  cg,  yg9  Pg9  and  <f>(yg)9  an  evaluation 
of  (3.2.7)  yields  .7374  as  the  value  of  the  mean  of  O  given  a  correct  answer  to  this  multiple- 
choice  item  g.  The  value  .7374  represents  the  mean  of  the  distribution  depicted  in  Figure  3.2.1. 

The  distribution  in  this  figure  is  readily  constructed.  The  value  of  the  ordinate  in  this  distribution, 
f(0  |  ug  =  1),  at  a  particular  value  of  the  abscissa,  0,  can  be  obtained  from 

f(0\u'g  =  1)  -  P’g(6)  <f>(6)  (3.2.8) 


-3.0 


i) 


0 


+  3.0 


Figure  3.2.1.  The  distribution  of  ability  given  ug  equal  to  one ,  0(w'  =  1),  or,  identically,  the  distribution  of 
0  resulting  from  incidental  selection  on  0  due  to  explicit  selection  on  the  continuous  variable  Zg9 
where  yg  is  the  cut  score  at  or  above  which  selection  is  complete  and  below  which  selection  occurs 
at  random  at  a  rate  cg. 
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for  the  range  of  values  of  0  from  negative  to  positive  infinity.  At  any  particular  value  6,  the  ordinate  is  the 
product  of  P'x(0),  the  probability  of  a  correct  answer  to  a  multiple-choice  item  g  as  provided  by  (3.1.12),  and 
<j>(6),  the  density  function  for  the  assumed  distribution  of  ability  as  defined  by  (2.2. 12).  When  the  values  of  the 
ordinate  as  obtained  from  (3.2.8)  have  been  plotted  with  respect  to  the  abscissa  for  the  range  of  values  from 
—  3.0  to  +3.0,  the  curve  delineating  the  distribution  in  Figure  3.2.1  is  the  result. 

From  integral  calculus  it  is  known  that  the  area  under  the  curve  described  by  (3.2.8)  is  />' ,  the  unconditional 
probability  of  a  correct  answer  to  a  multiple-choice  item  g.  Thus,  the  density  function  for  the  distribution  of 
0(ug  =  1),  <f>(8  |  «'  =  1),  is  provided  by 

<f>(d  |  «;  =  1)  =  (3.2.9) 

rK 

where  the  area  under  the  curve  described  by  this  equation  is  unity.  In  Equation  (3.2.9 ),f(6  |  «'  =  1)  is  the 
ordinate  of  the  distribution  of  Q(u'g  =  1)  as  given  by  (3.2.8)  and  P'g  is  the  unconditional  probability  of  a  correct 
answer  to  a  multiple-choice  item  g  as  provided  by  (3.2.1). 

Earlier  it  was  discussed  that  (2  1.11)  and  (2.1.15)  in  effect  translated  the  point  of  dichotomization  on 
the  continuous  variable  Zg  into  the  yg(6),  the  points  of  dichotomization  on  the  standardized  conditional  distributions 
of  Zg  given  9,  the  Zg(0).  This  translation  allowed  the  use  of  the  cumulative  normal  distribution  function,  <£[*], 
in  (3.1.12)  to  obtain  P'g(6),  the  probability  of  a  correct  answer  to  a  multiple-choice  item  g  given  9.  Now  if  y 
were  actually  a  cut  score  on  an  observed  continuous  variable  Zg,  then  the  yg(9)  would  be  the  corresponding  cut 
scores  on  the  standardized  conditional  distributions  of  Z?  given  9,  the  Z(9).  Under  this  interpretation,  P'^S) 
would  be  the  probability  of  being  selected  given  6.  In  this  situation,  selection  is  complete  at  and  above  a  cut 
score  of  yg(0)  and  occurs  at  random  at  a  rate  cg  below  a  cut  score  of  yg(6).  As  a  consequence  of  this  interpretation, 
the  distribution  depicted  in  Figure  3.2.1  as  generated  from  (3.2.8)  would  be  the  distribution  of  0  resulting  from 
incidental  selection  on  the  continuous  variable  0  due  to  explicit  selection  on  an  observed  continuous  variable 
Z?. 

Specific  Case:  The  Mean  of  O  Given  an  Incorrect  Answer  to  Item  g,  jjl(Q  |  u'g  =  0).  This  estimator  is 
a  least  squares  estimator  because  this  mean  provides  that  value  of  0  about  which  the  sum  of  squared  discrepancies 
is  minimized  for  the  variable  of  ability  given  an  incorrect  answer  to  a  multiple-choice  item  g.  A  convenient 
expression  for  this  estimator  of  ability  is  given  by 

K  =  0)  =  -  piZ.,6)  (3.2.10) 

where  p(Zs,0),  the  correlation  between  the  continuous  variables  Zg  and  0,  is  known  when  a„,  the  item  parameter 
of  discriminatory  power,  is  known  through  the  use  of  (2.2. 10);  yg,  the  point  of  dichotomization  of  the  continuous 
variable  ZA„  is  known  when  p(Zg,6)  and  bg,  the  difficulty  parameter  for  item  g,  are  known  through  the  use  of 
(2.2.2);  <f>(yg),  the  density  in  the  standard  normal  distribution  evaluated  at  yg,  is  defined  by  (2.2.5);  and  Q  , 
the  unconditional  probability  of  not  recognizing  the  correct  alternative  to  a  multiple-choice  item  g,  is  provided 
by  (2.2.3). 


Example  3.2.8  In  Example  3.1.1  piZg,0)  was  found  to  be  .86  for  item  g  as  portrayed 
in  Figure  3.1.1.  The  density  in  the  standard  normal  distribution  evaluated  at  yg,  ),  was  found 
to  be  .  2420;  and  Qg,  the  unconditional  probability  of  not  recognizing  the  correct  alternative  to 
this  item  g,  was  found  to  be  .8413.  When  (3.2.10)  is  evaluated  for  these  values  of  p(Z?,0), 

4>(yg),  and  Qg,  /x(0  |  ug  =  0),  the  mean  of  0  given  an  incorrect  answer  to  this  multiple-choice 
item  g,  is  known  to  be  -  .2474.  The  value  -  .2474  represents  the  mean  of  the  distribution  portrayed 
in  Figure  3.2.2. 

The  distribution  of  0  given  an  incorrect  answer  to  multiple-choice  item  g,  as  presented  in  this  figure,  is 
easily  constructed.  At  a  particular  value  of  the  abscissa,  0,  the  ordinate  of  this  distribution,  f(6  |  u'  =  0)  can 
be  obtained  from 


AO  I  u'g  =  0)  =  Q'g(0)  m  (3.2.11) 

for  the  range  of  values  for  O  from  negative  to  positive  infinity.  At  any  particular  value  0 ,  the  ordinate  is  the 
product  of  Qg(0),  the  probability  of  an  incorrect  answer  to  a  multiple-choice  item  g  as  provided  by  (3.1.14), 
and  </>(0),  the  density  function  for  the  assumed  distribution  of  ability  as  defined  by  (2.2.12).  When  the  values 
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-3,0 


0 


+  3.0 


Figure  3.2.2.  The  distribution  of  ability  given  ug  equal  to  zero ,  0(ug  =  0),  or,  identically,  the  distribution  of 
0  resulting  from  incidental  rejection  on  0  due  to  explicit  rejection  on  the  continuous  variable  Zg, 
where  yg  is  the  cut  score  below  which  rejection  occurs  at  random  at  a  rate  (1  —  cg). 


of  the  ordinate  as  obtained  from  (3.2.11)  have  been  plotted  with  reference  to  the  abscissa  for  the  range  of  values 
from  —3.0  to  +3.0,  the  curve  describing  the  distribution  in  Figure  3.2.2  is  the  result. 

From  integral  calculus  it  is  known  that  the  area  under  the  curve  delineated  by  (3.2.11)  is  Q g,  the 
unconditional  probability  of  an  incorrect  answer  to  a  multiple-choice  item  g.  Thus,  the  density  function  for  the 
distribution  of  0(ug  =  0),  </>(0  \  ug  =  0),  is  given  by 


<K6»  |  u’  =  0)  = 


fie  |  u'x  =  Q) 

q; 


(3.2.12) 


where  the  area  under  the  curve  described  by  this  equation  is  unity.  In  Equation  (3.2. 12),  f(6  \  u'g  =  0)  is  the 
ordinate  of  the  distribution  of  Q{u'g  =  0)  as  provided  by  (3.2.1 1),  and  Qg  is  the  unconditional  probability  of  an 
incorrect  answer  to  a  multiple-choice  item  g  as  given  by  (3.2.2).  Equation  (3.2.12)  can  be  simplified  to 


<t>(  6  |  u'g  =  0)  = 


q,(Q)  m 

e. 


(3.2.13) 


after  substitution  from  (3.2. 1 1)  into  (3.2. 12)  because  of  (3.1 . 14)  and  (3.2.2).  In  (3.2.13),  Qg(8)  is  the  probability 
of  not  recognizing  the  correct  alternative  to  a  multiple-choice  item  g  given  6 ,  as  provided  by  (2.1.20);  <£(0)  is 
the  density  function  for  the  assumed  distribution  of  ability,  as  defined  by  (2.2.12);  and  Qg  is  the  unconditional 
probability  of  not  recognizing  the  correct  alternative  to  a  multiple-choice  item  g ,  as  given  by  (2.2.3). 

It  has  often  been  mentioned  that  (2.1.11)  and  (2.1.15)  translate  the  point  of  dichotomization  on  the 
continuous  variable  Zg  into  the  yg(8),  the  points  of  dichotomization  on  the  standardized  conditional  distributions 
of  Zg  given  0,  the  Zg{6).  If  yg  is  considered  a  cut  score  on  an  observed  continuous  variable  Zg,  then  the  y  (0) 
would  be  the  corresponding  cut  scores  on  the  Zg(6).  Under  this  interpretation  Qg(6)  would  be  the  probability  of 
being  rejected  when  rejection  occurs  at  random  at  a  rate  (1  —  cg)  for  the  subpopulation  below  yg(6)  on  Zg(8). 
This  rejection  rate  is  random  because  depletion  on  the  interval  from  negative  infinity  to  yg(0)  on  Zg(6)  through 
lucky  guessing  is  assumed  to  occur  at  a  rate  cg.  As  a  consequence  of  this  interpretation,  the  distribution  portrayed 
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in  Figure  3.2.2  as  generated  from  (3.2.1 1)  would  be  the  distribution  of  0  resulting  from  incidental  rejection  on 
the  continuous  variable  0  due  to  explicit  rejection  on  an  observed  continuous  variable  Zg. 

General  Case.  In  the  general  case  of  least  squares  estimators  of  ability,  the  practitioner  prescribes  the 
mean  and  variance  of  0*,  the  continuous  variable  of  ability.  This  prescription  may  be  made  in  order  to  obtain 
estimates  of  ability  yielding  a  particular  mean  and  variance.  A  particular  mean  and  variance  may  be  convenient 
in  certain  applications.  How  this  prescription  is  obtained  and  used  is  illustrated  in  Chapter  8. 

The  parameters  ag,  item  discriminatory  power,  and  bg,  item  difficulty,  appropriate  for  the  specific  case 
where  the  continuous  variable  of  ability  has  a  mean,  n(0),  of  zero  and  a  variance,  o2(0),  of  unity  were  defined 
by  (2. 1.12)  and  (2. 1 . 13).  These  parameters  require  a  transformation  in  order  to  render  them  appropriate  for  the 
continuous  variable  0*  where  the  mean,  p.{0*),  and  the  variance,  a2(0*),  have  been  prescribed  by  the  prac¬ 
titioner.  After  fj.(0*)  and  cr2!©*)  have  been  prescribed  and  when  ag  and  bg  are  known,  the  parameters  a*,  item 
discriminatory  power,  and  b*,  item  difficulty,  that  are  appropriate  for  the  continuous  variable  0*  can  be  obtained 
from  (2.2.17)  and  (2.2.18).  The  third  item  parameter,  c* ,  the  coefficient  of  guessing  appropriate  for  0*,  is 
obtained  from 


C1  =  (3.2.14) 

because  the  lower  asymptote  of  the  item  characteristic  curve  as  defined  in  (3.1.17)  is  invariant  under  a  linear 
transformation  of  the  variable  of  ability. 

When  a *  is  known,  p(Zg,0),  the  correlation  between  the  continuous  variables  Zg  and  0*,  is  given  by 
(2.2.21);  and  when  a*  and  b*  are  known,  yg,  the  point  of  dichotomization  on  the  continuous  variable  Zg  is 
provided  by  (2.2.22).  Both  p(Zg,0)  and  yg  are  invariant  under  a  linear  transformation  of  the  variable  of  ability. 

General  Case:  The  Mean  of  0 *  Given  a  Correct  Answer  to  Item  g,  p(0*  |  «'  =  1).  This  least  squares 
estimator  of  ability  is  conveniently  provided  by 

Pl0*  |  u'g  =  1)=  fJ-(0*)  +  p(Zg,0)  a(0*)  ju(Zg  |  u'g  =  1) 

=  m(£*)  +  p(Zg,0)  o{0*)  (1  -  cg)  (3.2. 15) 

‘g 

In  (3.2.15),  il(0*)  and  cr(0*)  are  the  prescribed  mean  and  standard  deviation  of  the  continuous  variable  0*; 
p{Zg,0)  is  the  correlation  between  the  continuous  variables  Zg  and  0*  as  provided  by  (2.2.21);  p.(Z  |  u'g  =  1) 
is  the  mean  of  Zg  given  a  correct  answer  to  a  multiple-choice  item  g  as  given  by  (3.2.3);  cg  is  the  coefficient 
of  guessing  for  a  multiple-choice  item  g  as  defined  in  (3. 1.17);  yg  is  the  point  of  dichotomization  on  the  continuous 
variable  Zg  as  provided  by  (2.2.22);  <j>{yg)  is  the  density  in  the  standard  normal  distribution  evaluated  at  yg  as 
obtained  from  (2.2.5);  and  Pg  is  the  unconditional  probability  of  a  correct  answer  to  a  multiple-choice  item  g 
as  provided  by  (3.2.1). 

The  values  for  p(Zg,0),  yg,  4>(yg),  P'g,  and  p,(Zg  |  u'g  =  1)  remain  invariant  under  a  linear  transformation 
on  the  scale  of  the  continuous  variable  of  ability. 

Example  3.2.9.  In  the  illustration  that  will  be  provided  in  Chapter  8,  it  is  deemed  desirable 
to  obtain  ability  estimates  that  will  have  a  mean  of  100  and  a  standard  deviation  of  20.  If  the 
precision  of  these  estimates  is  held  constant  for  all  individuals  at  the  termination  of  testing  and 
comparable  to  that  achieved  with  a  test  reliability,  as  will  be  defined  and  described  in  Chapter  7, 
of.90,  then  the  mean,  /x(0*),  must  be  prescribed  as  100  and  the  variance,  o2(0*),  must  be 
prescribed  as  444.4444.  The  standard  deviation  must  then  be  21.0819. 

In  Example  3.1.1,  it  was  found  that  ag  for  item  g  as  portrayed  in  Figure  3.1.1  is  1 .6853. 

When  a*  of  (2.2.17)  is  evaluated  given  the  values  of  1.6853  for  ag  and  21.0819  for  o{0*),  a* 
is  found  to  be  .07994.  When  p(Zg,0 )  of  (2.2.21)  is  evaluated  with  these  values  of  a*  and  o{0*), 
p(Zg,0)  is  found  to  be  .86  (the  identical  value  that  was  obtained  through  the  use  of  (2.2.10)  in 
Example  3.2.7).  Evaluating  b*  of  (2.2.18)  given  the  values  of  1*.  1628,  as  obtained  from  Example 
3.1.1,  for  bg,  100  and  21.0819  as  prescribed  for  p(0*)  and  o(0*),  respectively,  b*  is  found  to 
be  124.5140.  In  obtaining  yg  from  (2.2.22)  given  the  values  of  .07994  for  a*,  124.5140  for  bf, 

100  for  p,(0*),  and  444.4444  for  o2(0*),  yg  is  found  to  be  1.00  (the  identical  value  that  was 
obtained  for  yg  through  the  use  of  (2.2.2)  in  Example  3.2.1).  Since  yg  is  still  1.00,  <pijg)  has 
already  been  determined.  Given  this  value  for  yg,  4>(yg)  was  found  to  be  .2420  in  Example  3.2.3. 

Since  yg  is  still  1.00  and  cg  as  found  in  Example  3.1.1  is  .11,  P'g  has  also  been  previously 
determined.  Given  these  values  for  yg  and  cg,  P'g  was  found  to  be  .2512  in  Example  3.2. 1 .  Since 
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cg,  and  Pg  are  each  invariant  under  a  linear  transformation  on  the  scale  of  the  continuous 

variable  of  ability,  p(Zg  |  ug  —  1),  as  determined  by  (3.2.3)  in  Example  3.2.3,  is  still  .8574. 

The  least  squares  estimator  of  ability,  p,(0*  |  «'  =  1),  can  now  be  evaluated  through  the 
use  of  (3.2.15).  In  this  situation  for  this  multiple-choice  item  g,  it  is  known  that  p.(0*)  is  100, 
p(ZgiO)  is  .86,  cr(0*)  is  21.0819,  and  p(Zg  |  ug  =  1)  is  .8574.  When  p,(0*  \  ug  =  1)  of  (3.2.15) 
is  evaluated  given  these  values,  the  least  squares  estimator  of  ability  is  found  to  be  115.5450. 

The  value  1 15.5450  represents  the  mean  of  the  distribution  depicted  in  Figure  3.2.1  after  a  linear 
transformation  of  0  into  0*.  This  transformation  can  be  effected  pictorially  by  merely  changing 
the  values  along  the  abscissa  from  —3.0  to  36.7543,  from  0  to  100,  and  from  +3.0  to  163.2457. 

With  this  transformation  on  the  scale  of  ability,  the  distribution  of  0*  given  a  correct  answer  or 
ug  equal  to  one ,  Q*(ug  =  1),  is  analogous  to  the  distribution  of  ability  after  incidental  selection 
on  0*  resulting  from  explicit  selection  on  an  observed  continuous  variable  Zg  where  y  is  the  cut 
score  at  and  above  which  selection  is  complete  and  below  which  selection  occurs  at  random  at  a 
rate  cg> 

General  Case:  The  Mean  of  0*  Given  an  Incorrect  Answer  to  Item  g ,  /i(0*  |  u'g  =  0).  This  least  squares 
estimator  of  ability  is  conveniently  provided  by 

jw(0*  |  u’g  =  0)  =  p(0*)  +  p(Zg,Q)  a(0*)  fx{Zg  |  u'g  —  0) 

=  /x(6*)  -  p(ZH,0)  aiO*)  (3.2.16) 

In  (3.2.16),  p«(0*)  and  o(0*)  are  the  prescribed  mean  and  standard  deviation  of  the  continuous  variable 
0*;  p(Z^,0)  is  the  correlation  between  the  continuous  variables  Zg  and  0*,  as  provided  by  (2.2.21); 
fi(Zg  |  u'g  =  0)  is  the  mean  of  Zg  given  an  incorrect  answer  to  a  multiple-choice  item  g  as  provided  by  (3.2.4); 
yg  is  the  point  of  dichotomization  on  the  continuous  variable  Zg  as  obtained  from  (2.2.22);  4>(yg)  is  the  density 
in  the  standard  normal  distribution  evaluated  at  yg  as  defined  in  (2.2.5);  and  Q  is  the  probability  of  not  recognizing 
the  correct  alternative  to  a  multiple-choice  item  g  as  provided  by  (2.2.3).  The  values  for  p(Z?,0),  y  4>(yg), 
Qg ,  and  p{Zg  \  u'g  =  0)  remain  invariant  under  a  linear  transformation  on  the  scale  of  the  variable  of  ability. 

Example  3 2.10.  As  in  the  instance  of  Example  3.2.9,  it  is  considered  desirable  to  obtain 
ability  estimates  that  at  the  termination  of  testing  will  have  a  mean  of  100  and  a  standard  deviation 
of  20.  These  respective  values  can  be  obtained  by  terminating  the  tests  for  all  individuals  at  a 
level  of  precision  comparable  to  that  achieved  with  a  test  reliability  of  .90  and  prescribing  the 
mean  of  ability,  p,(0*),  as  100,  and  the  variance  of  ability,  0^(0*),  as  444.4444,  or  the  standard 
deviation  of  ability,  o{0*),  as  21.0819. 

For  this  situation,  p(Z^,0),  yg,  and  </>( yg)  were  found  to  be  .86,  1.00,  and  .2420,  re¬ 
spectively,  in  Example  3.2.9.  Since  yg  is  invariant  under  a  linear  transformation  of  the  continuous 
variable  of  ability,  so  must  Qg ,  as  determined  by  (2.2.3),  be  invariant.  The  unconditional  prob¬ 
ability  of  not  recognizing  the  correct  alternative  to  multiple-choice  item  g,  Qg,  was  found  to  be 
.8413  in  Example  3.2.2.  The  mean  of  Zg  given  an  incorrect  answer  to  multiple-choice  item  g, 
p(Zg  |  ug  =  0),  or,  identically,  p(Zg  |  ug  —  0),  is  also  invariant  under  a  linear  transformation  on 
the  scale  of  the  continuous  variable  of  ability.  This  invariance  necessarily  follows  because  <£(%,) 
and  Qg  in  (3.2.4)  and  (2.2.6)  are  invariant  under  such  a  transformation.  In  Example  3.2.4, 
p(Zg  |  u'g  —  0),  or,  identically,  piZg  \  ug  =  0),  was  determined  to  be  —  .2877. 

The  least  squares  estimator,  /x(0*  |  ug  =  0),  can  now  be  evaluated  through  the  use  of 
(3.2.16).  In  this  situation  for  this  multiple-choice  item  g,  it  is  known  that  pf0*)  is  100,  p(ZA,,0) 
is  .86,  o{0*)  is  21.0819,  and  p(Zg  |  u’g  -  0)  is  -  .2877.  When  p,(0*  |  u'  =  0)  of  (3.2.16)  is 
evaluated  given  these  values,  the  least  squares  estimator  of  ability  given  an  incorrect  answer  to 
multiple-choice  item  g  is  found  to  be  94.7839.  The  value  94.7839  represents  the  mean  of  the 
distribution  portrayed  in  Figure  3.2.2  after  a  linear  transformation  of  0  into  0*.  Pictorially,  this 
linear  transformation  can  be  effected  by  merely  changing  the  values  along  the  abscissa  from  —  3.0 
to  36.7543,  from  0  to  100,  and  from  +3.0  to  163.2457.  With  this  transformation  on  the  scale 
of  ability,  the  distribution  of  0*  given  an  incorrect  answer  or  ug  equal  to  zero  is  analogous  to  the 
distribution  of  ability  after  incidental  rejection  on  0*  resulting  from  explicit  rejection  on  an 
observed  continuous  variable  Zg  where  yg  is  the  cut  score  below  which  rejection  occurs  at  random 
at  a  rate  (1  —  cg).  This  rate  is  random  because  the  depletion  of  the  subpopulation  through  lucky 
guessing  at  a  rate  cg  is  under  this  submodel  assumed  to  be  random. 
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The  developments  illustrated  in  Sections  2.2  and  3.2  provide  the  basis  for  the  estimation  of  an  individual’s 
ability  given  the  correctness  or  incorrectness  of  the  individual’s  answer  to  a  free -response  or  multiple-choice 
item.  In  tailored  testing  with  one  of  these  types  of  items,  interest  will  focus  on  a  sequence  of  such  estimations 
based  on  items  that  have  been  chosen  as  most  appropriate  for  that  individual.  The  sequence  is  terminated  when 
the  last  estimate  of  ability  is  sufficiently  precise. 

In  Chapter  5  the  illustrated  developments  of  Sections  2.2  and  3.2  will  be  extended  to  provide  the  basic 
algorithms  for  the  tailored  testing  of  individuals  with  either  free-response  or  multiple-choice  items.  But  before 
this  extension  takes  place,  a  more  complete  introduction  to  the  process  of  tailored  testing  is  in  order.  Such  an 
introduction  is  provided  in  Chapter  4. 

3.3.  Mathematical  Proofs 

The  mathematical  formulation  that  is  derived  in  this  section  was  presented  and  numerically  illustrated  in 
Section  3.2.  The  mathematical  proofs  of  this  formulation  as  contained  in  this  section  may  be  omitted  by  the 
reader  who  is  seeking  a  general  understanding.  The  omission  of  this  section  will  not  result  in  a  loss  of  continuity. 

In  earlier  discussion  it  was  noted  that  the  bivariate  normal  distribution  could  be  viewed  as  consisting  of 
infinitely  many  conditional  distributions  of  Zg  given  6,  or  as  consisting  of  infinitely  many  conditional  distributions 
of  O  given  £g.  After  standardization,  these  conditional  distributions  were  defined  as  the  Zg(0)  and  the  0(g  ), 
respectively.  The  standardized  conditional  distributions  of  Zg  given  0  have  been  discussed  in  considerable  detail 
with  respect  to  their  relationship  with  the  item  characteristic  curve  of  the  three-parameter  normal  ogive  submodel. 
An  illustration  was  provided  in  abbreviated  fashion  in  Figure  3.11.  The  analogous  illustration  for  the  conditional 
distributions  of  6  given  (g  is  provided  in  Figure  3.3.1.  In  this  figure,  the  following  features  are  important.  The 
projection  of  the  point  of  dichotomization,  yg9  across  the  bivariate  normal  distribution  runs  parallel  to  the 
distributions  of  0(^).  Above  the  point  of  dichotomization,  yg9  these  distributions  remain  intact  as  represented 
by  the  shaded  area  indicating  a  correct  answer  to  item  g,  u'g  =  1.  Below  the  point  of  dichotomization,  y  ,,  a 
proportion  cg  that  is  random  with  respect  to  the  subpopulations  in  the  Q(lg)  also  obtains  a  correct  score, 


u  —  1  (Shaded  Area;' 


u‘g  =0  (Unshaded  Area) 


Figure  3.3.1.  Hypothetical  relations  among  the  item  continuum  Zg9  the  binary  multiple-choice  item  Ug,  the 
conditional  distributions  of  0  given  £g,  and  the  latent  trait  O. 
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ug  =  1,  in  this  case  through  guessing  correctly.  This  condition  is  also  represented  by  the  shaded  area  in  the 
conditional  distribution  of  0(C)  located  below  yg.  Also  below  the  point  of  dichotomization,  y  the  remaining 
proportion  of  this  subpopulation,  that  is  (1  -  cg),  obtains  an  incorrect  answer  to  item  g,  u’g  =  0,  in  this  case 
through  guessing  incorrectly.  This  condition  is  represented  by  the  unshaded  area  in  the  conditional  distribution 
of  0(C)  located  below  the  point  of  dichotomization,  yg.  Because  successful  guessing  is  assumed  random  on  the 
interval  of  Z g  from  negative  infinity  to  yg,  it  is  by  extension  assumed  random  with  respect  to  the  conditional 
distributions  located  below  the  point  of  dichotomization,  yg.  Thus  the  means  and  variances  of  the  conditional 
distributions  of  0(£g)  are  invariant  under  the  imposition  of  the  further  condition  as  to  whether  item  g  was  answered 
correctly  or  incorrectly.  These  relationships  become  important  when  selection  theory  is  considered  in  Chapter 
5.  These  relationships  can  be  sharply  contrasted  with  those  presented  in  Figure  3.1.1,  where  the  binary  scoring 
of  item  g  involves  a  bisection  of  the  conditional  distributions  of  Zg(6)  which,  along  with  considerations  of  success 
due  to  guessing,  gives  rise  to  the  item  characteristic  curve  as  depicted  in  Figure  3.1.2. 

Similarities  between  the  two-  and  three-parameter  normal  ogive  submodels  have  often  been  noted.  These 
similarities  will  facilitate  the  developments  within  this  section.  Consequently,  the  present  developments  will 
frequently  refer  to  those  of  Section  2.3  for  the  two-parameter  normal  ogive  submodel.  Several  convenient 
expressions  will  be  derived  in  the  present  section.  Again,  the  point  of  departure  for  these  derivations  will  be  the 
defining  relationships  within  the  bivariate  normal  distribution.  For  the  initial  stage  of  derivation,  the  reader  may 
find  Figure  2.3.2  helpful  in  visualizing  the  particular  defining  relationship  that  serves  as  the  basis  for  the  derivation. 
During  this  process,  the  reader  should  keep  in  mind  the  role  of  guessing  as  delineated  for  this  submodel. 

The  Unconditional  Probabilities  for  the  Realizations  of  Ufg 


The  binary  random  variable  Ug  can  realize  one  of  two  possible  values,  either  a  one,  or  a  zero ,  indicating 
a  correct  or  an  incorrect  answer,  respectively,  to  a  multiple-choice  item  g.  Expressions  will  now  be  derived  for 
the  probabilities  of  these  two  possible  outcomes. 

The  Probability  of  a  Correct  Answer  to  Item  g ,  Pr  (ug  =  1).  This  probability  is  commonly  referred  to  as 
the  p-value  for  item  g  It  is  designated  as  merely  Pg.  By  definition  it  is  then  known  that 


Pg  =  Pr(«;  =  I)  =  Pr (Zg  3=  %)  +  c.  Pr(Z  <  yg) 


/*oc  rx 

Jy  J  -o 


4>{L,6)d0dL  +  c. 


r. 


<KL,0)  do  dig. 


(3.3.1) 


where  substitutions  from  (2.3.26)  and  (2.3.32)  provide 

Pg  —  Pg  +  cg  Qg . 

Upon  noting  that  Qg  is  the  complement  of  Pg,  one  may  write 

P’e  =  Pg  +  e,(  1  -  Pg) 


which  simplifies  to 


P'g  =  Cg  +  ( 1  -  Cg)  Pg. 

Substitutions  from  (2.3.31)  into  (3.3.4)  now  provide  the  result 


(3.3.2) 

(3.3.3) 

(3.3.4) 


p's  =  cg  +  “  cs)  J  (27r)  '5  exp(-.5  (|)  dCg 

^g 

=  Cg  +  (1  -  cg)  J_f  2n)~-5  exp(-  .5  1%)  dig 

=  Cg  +  (\  -  Cg)  <P[-yg],  (3.3.5) 

where  <£[*]  is  by  definition  the  cumulative  normal  distribution  function.  The  equality  of  integrals  in  (3.3.5)  is 
due,  again,  to  the  symmetry  of  the  normal  distribution.  The  probability  of  a  correct  answer  to  item  g,  P',  is 
pictorially  represented  by  the  shaded  area  in  the  marginal  distribution  of  Zg  in  Figure  3.1.1. 

The  Probability  of  an  Incorrect  Answer  to  Item  g,  Pr(w'  =  0).  As  will  become  evident,  this  probability 
is  the  complement  of  P'g  or  (1  -  P'g),  because  the  area  in  the  standard  normal  distribution  is  unity.  This  probability 
is  designated  as  Q' 
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By  definition,  it  is  known  that 

Q't  =  Pr (u'  =  0)  =  (1  -  cg)  Pr iZg  <  yg) 

=  (1  -  Cg)  ff  f  ^  <K£g,8)  do  dCg,  (3.3.6) 

where  a  substitution  from  (2.3.32)  yields 

Q't  =  0  -  cg)  Qg.  (3.3.7) 

Substitutions  from  (2.3.35)  into  (3.3.7)  now  provide 

Q't  =  a  -  C,)  /I  (2t7)--5  exp(-  .5  g)  dig  =  (1  -  c,)  (3.3.8) 

where  <P[*]  has  previously  been  defined.  The  probability  of  an  incorrect  answer  to  item  g  is  portrayed  in  Figure 
3.1,1  as  the  unshaded  area  in  the  marginal  distribution  of  Zg. 

In  order  to  ascertain  that  the  unconditional  probabilities  P'g  and  Qg  are  indeed  complementary,  it  must  be 
proved  that 

Pg  +  Qg  =  1-  (3.3.9) 

Substitutions  from  (3.3.2)  and  (3.3.7)  into  (3.3.9)  directly  yield 

Pg  +  Qg  =  1  (3.3.10) 

in  verification  of  (3.3.9),  because  Pg  as  given  in  (2.3.31)  and  Qg  as  given  in  (2.3.35)  were  found  to  be 
complementary  probabilities  accounting  for  the  total  area  in  the  standard  normal  distribution  where  this  total 
area  is  unity.  The  complementary  relationship  between  P',,  as  represented  by  the  shaded  area,  and  Qg  as  represented 
by  the  unshaded  area,  is  also  pictorially  displayed  with  respect  to  the  normal  distribution  of  Zg  in  Figure  3.1,1. 

The  Conditional  Means  of  Zg  Given  the  Realizations  of  U'g 


The  mean  of  Zg  can  realize  only  one  of  two  possible  values,  contingent  upon  whether  item  g  was  answered 
correctly  or  incorrectly.  Expressions  will  now  be  derived  for  these  means  or  expected  values  for  the  two  possible 
outcomes. 

The  Mean  of  Zg  Given  a  Correct  Answer  to  Item  g ,  fi(Zg  |  u'g  =  1).  This  mean  is  given  by 


Viz.  I  Ml  =  1)  =  %(Zg  I  uL  =  1) 


=JX 


L  4*'(L,d)  d0  dL  +  Cg 


L<t>*XL,6)d6  dL,  (3.3.11) 


where  </>*'(£g,0),  the  joint  density  function  for  the  particular  composite  of  probability  integrals,  is  provided  by 


<£*'(&, <?) 


<KC*,0) 


(3.3.12) 


In  order  to  verify  that  (3.3.12)  is  indeed  the  joint  density  function  for  the  composite  of  probability  integrals,  it 
is  essential  to  show  that  the  particular  composite 


(&,0)  dd  dig  +  cg 


V(ig,d)  dQ  dis 


(3.3.13) 


equals  unity.  After  a  substitution  from  (3.3.12)  into  (3.3.13),  one  may  write 


p' 

r  g  L 


n: 


<KL,0)  d0  dL  +  c. 


n  r 
J-J-. 


ct>(L,d)  dd  dL 


where  substitutions  from  (2.3.26)  and  (2.3.32)  yield 


+ 


cg  2g)- 


(3.3.14) 


(3.3.15) 
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(3.3.16) 


The  substitution  of  (3.3.2)  into  (3.3.15)  now  provides 


p ' 

Lk 


in  verification  of  (3.3.12)  as  the  joint  density  function,  because  (3.3.16)  is  obviously  equal  to  unity. 
After  a  substitution  from  (3.3.12)  into  (3.3.11),  one  may  write 


fx(Zg  |  Ug  =  1)  =  %(ZM  |  Ug  =  1) 

1 


K 


a: 


L  4>(L,6)  dd  dL  +  Co 


x  J  -x 


L  <KL,Q)  dd  dL 


where  (2.3.40)  and  (2.3.53)  can  be  rearranged  to  yield 

MC Zg  I  «,  =  1  )Pg  = 

and 

fi(Zg  I  ug  =  0)  Qg  = 


Ilf 


i,  <KCg,0)  de  dL 


L  <KL>0)  de  dL, 


(3.3.17) 


(3.3.18) 


(3.3.19) 


respectively,  for  substitution  into  (3.3.17).  After  these  substitutions  are  made,  the  composited  mean  may  be 
expressed  as 


I  K  =  1)  = 


n. 


fi(Z  |  ug  =  1)  4- 


cgQg 

P'g 


MZg  I  Ug  =  0), 


(3.3.20) 


where  the  bracketed  weights  sum  to  unity  because  of  (3.3.2)  and  provide  the  relative  frequencies  for  the  means 
resulting  from  the  dichotomization  of  Zg.  These  means,  of  course,  are  identically  those  for  Z  in  the  two- 
parameter  normal  ogive  submodel.  Substitutions  from  (2.3.48)  and  (2.3.59)  into  (3.3.20)  now  provide  the  desired 
result 


KZg  |  u'  =!)  =  (!-  Co) 


<ttyg) 


p' 

rs 


(3.3.21) 


as  a  convenient  expression  for  the  mean  of  Zg  given  a  correct  answer  to  a  multiple-choice  item  g. 

The  Mean  of  Zg  Given  an  Incorrect  Answer  to  Item  g,  fi(Zg  |  u'g  =  0).  This  mean  is  given  by 


H(Zg  |  u'  =  0)  =  %(Z  |  Ug  =  0) 


=  0  -  cg) 


oc  J  —  cc 


Cg  0+'C?,0)  de  dL, 


where  <F'(Cg,6),  the  joint  density  function  for  the  probability  integral,  is  given  by 


<P'(Cg,0)  = 


(3.3.22) 


(3.3.23) 


In  order  to  ascertain  that  (3.3.23)  represents  the  joint  density  function  for  the  probability  integral,  one  needs  to 
prove  that  the  particular  probability  integral 


(1  1-1  \_J^Cg,S)d9dCg 


equals  unity.  After  a  substitution  from  (3.3.23)  into  (3.3.24),  one  may  write 

(1  -  Co)  rr*  fx 

— gp  J_J  _x<KCg,8)ded£g, 

where  a  substitution  from  (2.3.32)  allows  the  writing  of 

~  Q& 

Qg  ' 


(3.3.24) 


(3.3.25) 


(3.3.26) 
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(3.3.27) 


The  further  substitution  from  (3.3.7)  into  (3.3.26)  now  provides 

01 

Ql 

in  verification  of  (3.3.23),  because  (3.3.27)  is  obviously  equal  to  unity. 
The  substitution  of  (3.3.23)  into  (3.3.22)  allows  one  to  write 


fi(Zg  |  u'g  =  0)  =  %(Zg  |  u'g  =  0) 
(1  " 


Q, 


L  dOdL 


where  a  substitution  from  (3.3.19)  yields 

mCZ*  I  u'g  =  0)  =  %(Zg  |  u'g  =  0) 

o  -  £g)  6, 


g; 


/x(Z  |  u  =  0). 


A  substitution  from  (3.3.7)  into  (3.3.29)  now  produces 

fx{Zg  |  u’g  =  0)  =  ii(Zg  |  ug  =  0), 


(3.3.28) 


(3.3.29) 


(3.3.30) 


illustrating  that  the  mean  of  Zg  given  an  incorrect  answer  to  item  g  is  identically  defined  for  the  two-  and  three- 
parameter  normal  ogive  submodels  as  designed  for  free-response  and  multiple-choice  items,  respectively.  A 
substitution  from  (2.3.59)  into  (3.3.30)  provides  the  desired  result: 


fi(Zg  |  uf g  =  0)  = 


<KyR) 

Q* 


(3.3.31) 


as  a  convenient  expression  for  the  mean  of  Zg  given  an  incorrect  answer  to  a  multiple-choice  item  g. 


The  Conditional  Variances  of  Zg  Given  the  Realizations  of  Ug 


The  variance  of  Zg  can  assume  only  one  of  two  possible  values  depending  on  whether  item  g  was  answered 
correctly  or  incorrectly.  Expressions  will  now  be  derived  for  these  variances  given  the  two  possible  outcomes. 

The  Variance  of  Zg  Given  a  Correct  Answer  to  Item  g,  ct2( Zg  |  ug  =  1).  In  order  to  solve  for  the  variance 
of  Zg  given  a  correct  answer  to  item  g,  one  first  obtains  an  expression  for  %(ZfK  \  u'g  =  1).  This  quantity  represents 
the  expected  value  for  the  sum  of  squared  deviations  from  a  mean  that  was  appropriate  before  the  truncation  of 
Zg  at  yg.  One  later  obtains  an  expression  for  the  desired  variance,  (ZZg  |  ug  =  1),  or  the  expected  value  of  the 
sum  of  squared  deviations  about  fi(Zg  \  ug  =  1)  as  given  in  (3.3.21)  through 


-'s  i  “g 


1 «;  =  d 


rr.s 


u'g  =  1)  -  ii\Zg  I  u'g  =  1), 

(3.3.32) 

1)  given  the  identity 

u'g  =  1)  +  fV(Zg  1  u'g  =  1). 

(3.3.33) 

1),  it  is  known  by  definition  that 

de  dig  +  c?  ff  f  _x  eg  4>*'((g,0)  de  dig. 

(3.3.34) 

where  <f>*'(£g,6)  is  given  by  (3.3.12)  and  verified  as  the  joint  density  function  in  the  discussion  surrounding 
(3.3.16).  After  a  substitution  from  (3.3.12)  into  (3.3.34)  one  may  write 


K  =  i)  = 


P ' 

1  g 


f  [  cl  <K^e)  de  d£g  + 


G  <KCt,Q  de  dcg 


(3.3.35) 


where  (2.3.63)  and  (2.3.86)  may  be  rearranged  to  yield 


I  «,  =  1)  P, 


-a 


C  4KL,e)  de  dL 


(3.3.36) 
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and 


%(%  K  =  0)  Qg 


£  <Ktg,6)  d6  dCg, 


(3.3.37) 


respectively,  for  substitution  into  (3.3.35).  After  these  substitutions  are  made,  the  composited  expected  value 
may  be  expressed  as 


%(Zi  |«:=d  = 


%(2r  |  u  ,  —  1)  + 


cgQg 


P' 

rg  J 


0), 


(3.3.38) 


where  the  bracketed  weights  sum  to  unity  because  of  (3.3.2)  and  provide  the  relative  frequencies  for  the  appropriate 
expected  values  that  result  from  the  dichotomization  of  Zg.  These  expected  values,  of  course,  are  identically 
those  for  the  two-parameter  normal  ogive  submodel.  Substitutions  from  (2.3.81)  and  (2.3.95)  into  (3.3.38) 
provide 


\  +  y&^yA 

+  c-*& 

1 

y*  fry*) 

n 

L  p„  J 

P' 

1  g 

Q«  J 

which  simplifies  to 


wg  K  =  •) 


»  —  n  -  +  cfis  +  (j  -  c  )  2k  'A 


P' 

1  g 


g'  p* 
r  g 


or,  merely, 


%{Pg  |  u'g  =  1)  =  1  +  (1 


cg) 


y&  &2&1 

P'  ’ 

1  g 


(3.3.39) 


(3.3.40) 


(3.3.41) 


because  of  (3.3.2).  Substitutions  from  (3.3.41)  and  from  the  squared  result  of  (3.3.21)  into  (3.3.32),  after  some 
rearrangement,  provide  the  desired  result 


cr{Zg  |  ug  =  1)  =  1 


(1  -  </>(%, )  (1  -  cg)  <f>(yg)  _ 

p>  p’  Tg 

r  g  L  r  g 


(3.3.42) 


as  a  convenient  expression  for  the  variance  of  Zg  given  a  correct  answer  to  a  multiple-choice  item  g . 

The  Variance  of  Zg  Given  an  Incorrect  Answer  to  Item  g,  o2{ Z g  |  —  0).  In  order  to  solve  for  the 

variance  of  Zg  given  an  incorrect  answer  to  a  multiple-choice  item  g ,  o2(Zg  |  ug  =  0),  one  first  obtains  an 
expression  for  %(Zj;  \  ug  =  0).  This  quantity  represents  the  expected  value  for  the  sum  of  squared  deviations 
from  a  mean  that  was  appropriate  before  the  truncation  of  Zg  at  yg.  One  later  obtains  an  expression  for  the 
desired  variance,  o2{Zg  \  ug  =  0),  or  the  expected  value  of  the  sum  of  squared  deviations  about 
fjb(Zg  |  m'  =  0)  as  given  in  (3.3.31)  through 

^(Zg  I  u'g  =  0)  =  I  u'g  =  0)  -  p-2{Zg  I  u'g  =  0),  (3.3.43) 

which  provides  an  explicit  solution  for  cP(Zg  |  u'g  —  0)  given  the  identity 

%{&g  |  ug  =  0)  =  a2(Zg  |  u'g  =  0)  +  n\Zg  |  u'g  =  0).  (3.3.44) 

Proceeding  with  the  solution  for  %(Z^  \  u'g  =  0),  it  is  known  by  definition  that 


%(Z2g  |  u'g  =  0)  =  (1 


< t?'Uv(hd0  d^. 


(3.3.45) 


where  <t>f'(£g,0)  is  given  by  (3.3.23)  and  verified  as  the  joint  density  function  for  this  particular  probability 
integral  in  the  discussion  surrounding  (3.3.27).  A  substitution  from  (3.3.23)  into  (3.3.45)  allows  one  to  write 

%(Z?g  I  u'g  =  0)  =  (1  ~q,Cr)  fl  f_"  Cg  <tt£g,0)  de  dig,  (3.3.46) 


where  a  substitution  from  (3.3.37)  yields 
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%{Zl  I  ug  =  0)  - 


(3.3.47) 


or,  merely 


%(Zi  | «;  =  o)  =  |  Uf,  =  o), 


(3.3.48) 


because  of  (3.3.7).  Thus,  the  particular  expected  values  given  in  (3.3.48)  are  identically  defined  for  the  two- 
and  three-parameter  normal  ogive  submodels.  A  substitution  from  (2.3.95)  into  (3.3.48)  now  yields 


(3.3.49) 


Final  substitutions  from  (3.3.49)  and  from  the  squared  result  of  (3.3.31)  into  (3.3.43),  along  with  some  rear¬ 
rangement,  now  provide  the  desired  result 


(3.3.50) 


as  a  convenient  expression  for  the  variance  of  Z g  given  an  incorrect  answer  to  a  multiple-choice  item  g.  Upon 
comparing  (3.3.50)  with  (2.3.96),  it  may  be  noted  that  the  variance  of  Zg  given  an  incorrect  answer  to  item  g 
is  identically  defined  for  the  two-  and  three-parameter  normal  ogive  submodels. 

The  expressions  for  the  variances  as  provided  in  (3.3.42)  and  (3.3.50)  will  have  further  use  in  later 
derivations  in  Chapter  5.  Specifically,  these  equations  will  provide  inputs  for  the  derivations  of  the  restricted 
variances  of  ability  given  the  realizations  of  the  binary  variable  U f 

The  Least  Squares  Estimators  of  Ability  Given  the  Realizations  of  U'g 

Since  the  mean  is  the  point  about  which  the  sum  of  squared  deviations  is  minimized,  least  squares 
estimators  of  ability  for  the  possible  realizations  of  the  binary  variable  U'g  are  readily  obtained. 

(a)  Specific  Case.  For  the  specific  case  where  O  has  a  mean  of  zero  and  a  variance  of  unity,  these 
estimators  are  merely  the  means  of  O  given  the  two  possible  outcomes:  the  mean  of  0  given  a  correct  answer 
to  a  multiple-choice  item  g,  pi(0  \  ug  —  1),  and  the  mean  of  0  given  an  incorrect  answer  to  a  multiple-choice 
item  g,  jj.(0  |  ug  -  0).  These  least  squares  estimators  of  ability  will  now  be  derived  for  the  specific  case. 

Specific  Case :  The  Mean  of  0  Given  a  Correct  Answer  to  Item  g,  /x(0  |  u'g  =  1).  In  order  to  obtain  a 
convenient  expression  for  the  mean  of  0  given  a  correct  answer  to  a  multiple-choice  item  g,  one  must  evaluate 
the  defining  relationship 


fx(0  |  ufg  =  1)  =  %(0  |  =  1) 


(3.3.51) 


where  is  given  by  (3.3.12)  and  verified  as  the  joint  density  function  in  the  discussion  surrounding 

(3.3.16).  A  substitution  from  (3.3.12)  into  (3.3.51)  allows  the  writing  of 


p(0  |  =  1)  -  %{0  |  u’g  =  1) 


(3.3.52) 


For  subsequent  substitution  into  (3.3.52),  (2.3.98)  and  (2.3.1 10)  may  be  rearranged  to  yield 


(3.3.53) 


and 


(3.3.54) 
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(3.3.55) 


respectively.  After  these  substitutions  are  made,  one  may  express  the  composited  mean 


[Pg] 

cg  Qg 

© 

of. 

II 

II 

_ <s 

p' 

L'sJ 

fx{  O  |  ug  —  1 )  + 

[  n  J 

ix{0  |  ug  =  0), 


resulting  from  the  weighting  of  means.  As  can  be  deduced  from  (3.3.2),  the  bracketed  weights  that  form  the 
composite  in  (3.3.55)  sum  to  unity.  These  weights  thus  represent  the  relative  frequencies  for  the  means  that 
resulted  from  the  dichotomization  of  Zg  at  yg.  These  means,  of  course,  are  identically  those  defined  for  the  two- 
parameter  normal  ogive  submodel. 

Substitutions  from  (2.3.107)  and  (2.3.115)  into  (3.3.55),  along  with  some  rearrangement,  allow  the 
writing  of 


P-(0  |  u'g 


1)  =  p(Zg,0) 


ug  -  \)  + 


Cg  Qf! 


V-(Zg  I  Ug  =  0) 


(3.3.56) 


where  a  substitution  from  (3.3.20)  provides 

p(0  I  u'g  =  1)  =  p(Zg,0)  p.(Zg  I  u'g  =  1).  (3.3.57) 

A  final  substitution  from  (3.3.21)  into  (3.3.57)  yields  the  desired  result 

(h(y  ) 

I  u'g  =  1)  =  p(Zg,0)(  1  -  Cg)^jf-  (3.3.58) 

as  a  convenient  expression  for  the  least  squares  estimator  of  O  given  a  correct  answer  to  a  multiple-choice 
item  g. 

Specific  Case:  The  Mean  of  O  Given  an  Incorrect  Answer  to  Item  g ,  p,(Q  \  u'g  =  0).  In  order  to  obtain 
an  expression  for  the  mean  of  0  given  an  incorrect  answer  to  a  multiple-choice  item  g ,  one  must  evaluate  the 
defining  relationship 

p(0  \  u'g  =  0)  =  %{Q  |  —  0) 

=  (1  -  Cg)  jf  f  x  0  <t>r(£g,d)  dd  d£g  (3.3.59) 


where  <f)'(£g,d)  is  given  by  (3.3.23)  and  verified  as  the  joint  density  function  in  the  discussion  surrounding 
(3.3.27).  A  substitution  from  (3.3.23)  into  (3.3.59)  allows  one  to  write 

p.(0  |  u'g  =  0)  =  %{0  |  u'g  =  0) 

(i  -  Co)  p*  r 

=  — of  J.J _J<Htg,e)dedtg,  (3.3.60) 

where  a  substitution  from  (3.3.54)  yields 

P-(0  |  u'g  =  0)  =  - — Qs  p{0  |  Ug  =  0)  (3.3.61) 

or,  merely 

I  u'g  =  0)  =  pl(6  I  Ug  =  0)  (3.3.62) 


because  of  (3.3.7).  Thus  the  least  squares  estimator  of  0  given  an  incorrect  answer  to  item  g  is  identically 
defined  in  the  submodels  designed  for  free-response  and  multiple-choice  items.  This  finding,  of  course,  results 
from  the  assumption  that  success  due  to  guessing  is  random  on  the  interval  of  from  negative  infinity  to  y  . 
After  a  substitution  from  (2.3.1 15)  into  (3.3.62)  one  has 

p(0  |  u'g  =  0)  =  p(Zg,0)  p(Zg  |  ug  =  0),  (3.3.63) 

where  a  final  substitution  from  (2.3.59)  yields  the  desired  result 

p.(0  |  u'g  =  0)  =  -  p{Zg,0)  (3.3.64) 

as  a  convenient  expression  for  the  least  squares  estimator  of  0  given  an  incorrect  answer  to  a  multiple-choice 
item  g. 
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General  Case .  As  mentioned  earlier,  the  general  case  allows  the  examiner  to  prescribe  the  scale  of  ability 
or  the  mean  and  variance  of  0*,  /i,(0*),  and  0^(0*).  Under  this  case  0  may  be  viewed  as  resulting  from  the 
standardization  of  0*.  This  relationship  was  given  in  (2.3. 1 17).  An  explicit  solution  for  0*  was  given  in  (2.3. 118). 
It  was  also  mentioned  that  the  general  case  subsumed  the  specific  case  of  least  squares  estimators  when  /i(0*) 
was  prescribed  as  zero  and  0^(0*)  was  prescribed  as  unity.  Further  it  was  noted  that  the  item  parameters  ag 
and  bg  of  (2. 1.12)  and  (2.1.13),  respectively,  are  not  appropriate  for  the  general  case — the  sole  exception  being 
the  subsumed  case.  The  appropriate  parameters,  a*  and  b*  were  defined  in  (2.3.119)  and  in  (2.3.120),  respec¬ 
tively.  These  parameters  are  still  appropriate  for  a  multiple-choice  item  g  or  the  three-parameter  normal  ogive 
submodel  given  the  general  case.  In  the  instance  of  the  third  parameter,  c*,  one  merely  has 


c*  =  cg,  (3.3.65) 

where  c*  represents  the  lower  asymptote  of  the  regression  of  a  multiple-choice  item  g  on  0*.  These  item 
parameters  guarantee  that  the  probability  of  obtaining  a  correct  answer  to  a  multiple-choice  item  g  remains 
invariant  under  arbitrary  prescriptions  for  the  scale  of  ability,  that  is,  the  mean  and  variance  of  0*,  /x(0*),  and 
(j2(0*).  Convenient  expressions  for  p(Zg,6)  given  a*  and  yg  given  a*  and  b*  were  provided  earlier  in  (2.3. 126) 
and  (2.3.128),  respectively. 

For  the  general  case,  the  least  squares  estimators  of  ability  are  merely  the  means  of  0*  given  the  two 
possible  outcomes:  the  mean  of  0*  given  a  correct  answer  to  a  multiple  choice  item  g,  /x(0  |  ug  =  1),  and  the 
mean  of  0*  given  an  incorrect  answer  to  a  multiple-choice  item  g,  /x(0*  |  ug  =  0).  Estimators  of  ability  for 
this  general  case  will  now  be  derived. 

General  Case:  The  Mean  of  0*  Given  a  Correct  Answer  to  Item  g,  /u(0*  |  ug  —  1).  In  order  to  obtain 
an  expression  for  the  mean  of  0*  given  a  correct  answer  to  a  multiple-choice  item  g,  one  must  evaluate  the 
defining  relationship 

H(6*  |  ug  =  1)  =  ^(0*  |  ug  =  1) 

=  fy  f  .  0*  <£*'(4-0)  do d£g  +  cg  ff  f  x  0*  <£*'(4,0)  cie  d£g,  (3.3.66) 


where  <j>*'(£g,6)  is  given  by  (3.3. 12),  verified  as  the  joint  density  function  in  the  discussion  surrounding  (3.3.16), 
and  still  appropriate  here  because  of  (2.3  1 17)  and  (2.3. 1 18).  A  substitution  from  (3.3. 12)  into  (3.3.66)  allows 
the  writing  of 


p-iO* 


1)  =  %(0* 

_  P' 

1  8 


l) 

0*  <£(4,0)  dd  dL  +  c. 


i:r 


0*  <£(4>0)  dd  d£ 


(3.3.67) 


where  (2.3.130)  and  (2.3.141)  may  be  rearranged  to  yield 


M(0*  I  ut  =  1)  Pg  =  ]  f_x  0*  <£(4,0)  dO  d£g  (3.3.68) 

* 8  J 

and 

fy  foe 

M(0*  |  ug  =  0)  Qg  =  j  f  J_x  0*  <£(4,0)  dd  d£g,  *  (3.3.69) 


respectively,  for  substitution  into  (3.3.67).  After  these  substitutions  are  made,  one  may  express  the  composited 
mean 


Pie*  | «;  =  i)  = 


n. 


I  u  =  1) 


'c,Qg 

p' 

.  r8  J 


|  u  =  0), 


(3.3.70) 


resulting  from  a  weighting  of  means.  As  can  be  deduced  from  (3.3.2),  the  bracketed  weights  that  form  the 
composite  sum  to  unity.  These  weights  thus  represent  the  relative  frequencies  for  the  means  that  resulted  from 
the  dichotomization  of  Zg  at  yg.  These  weighted  means,  of  course,  are  identically  those  defined  for  the  two- 
parameter  normal  ogive  submodel. 

Substitutions  from  (2.3.138)  and  (2.3.146)  into  (3.3.70),  along  with  some  rearrangement,  allow  one  to 

write 
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/x(@*  I  u'g  =  1)  = 


P' 
.g  J 


+ 


MO*)  +  p(Zg,e )  a (6>*)  ,x{ZH  |  ug  =  1)] 

cgQg 


K 


MO*)  +  p(Zg>0)  a{6*)  n(Zg  |  ug  =  0)]. 


Because  of  (3.3.2)  one  may  write 

H{Q*  |  u'g  =  1)  =  p(0*)  +  p(Zg,0 )  cr(0*) 


P' 

.  g. 


/x(Z?  I  M„  —  1)  + 


n 


where  a  substitution  from  (3.3.20)  into  (3.3.72)  provides 

fi(Q*  |  u'g  =  1)  =  /x(0*)  +  p(Zg,0)  o(0 *)  /x(Z^  |  «g  =  1). 
A  final  substitution  from  (3.3.21)  into  (3.3.73)  yields  the  desired  result 

<Kygl 


p(0*  I  u'  =  1)  =  m(0*)  +  P(Z„,0)  cr(0*)(l  -  c„) 


(3.3.71) 


MZ„  |  ug  =  0)  \  (3.3.72) 


(3.3.73) 


(3.3.74) 


as  a  convenient  expression  for  the  least  squares  estimator  of  ability,  0*,  given  a  correct  answer  to  a  multiple- 
choice  item  g. 

General  Case:  The  Mean  of  0*  Given  an  Incorrect  Answer  to  Item  g,  /x(0*  |  ufg  —  0).  In  order  to  obtain 
an  expression  for  the  mean  of  0*  given  an  incorrect  answer  to  a  multiple-choice  item  g ,  /x(0*  |  u '  =  0),  one 
must  evaluate  the  defining  relationship 

M(0*  |  u’g  =  0)  =  ^(0*  |  u’g  =  0) 

=  0  -  e,)  ff  f  x  e *  <t>f'(Cg,e)  dd  dig,  (3.3.75) 


where  ^+,(^,P)  is  given  by  (3.3.23),  verified  as  the  joint  density  function  in  the  discussion  surrounding  (3.3.27), 
and  still  appropriate  because  of  (2.3.117)  and  (2.3.118).  A  substitution  from  (3.3.23)  into  (3.3.75)  allows  the 
writing  of 

MO*  |  u'g  =  0)  =  ^(0*  |  u'g  =  0) 

(1  —  c  )  ry  r°° 

=  Q,  1  J ^  J  w  e*  <KZg,d)  de  d£g,  (3.3.76) 

where  a  substitution  from  (3.3.69)  yields 

p(6*  |  «;  =  0)  =  (l  ~  C,g)  ^  /*(©*  I  uh  =  °)  (3.3.77) 

*4 


or,  merely 


Me*  |  «;  =  o)  =  Me*  I  u8  =  o), 


(3.3.78) 


because  of  (3.3.7).  Thus  the  least  squares  estimator  of  0*  given  an  incorrect  answer  to  item  g  is  identically 
defined  for  the  submodels  designed  for  the  free-response  and  multiple-choice  cases.  The  finding,  of  course,  is 
a  result  of  the  assumption  that  success  due  to  guessing  in  the  case  of  the  three-parameter  normal  ogive  submodel 
is  assumed  to  occur  at  random  on  the  interval  of  Zg  from  negative  infinity  to  yg.  After  a  substitution  from 
(2.3.146)  into  (3.3.78),  one  has 

/x(0*  |  u'g  =  0)  =  m(0*)  +  p(Zg,0)  erf 0*)  ix(Zg  |  ug  =  0),  (3.3.79) 

where  a  final  substitution  from  (2.3.59)  into  (3.3.79)  yields  the  desired  result 

( h(y  ) 

M©*  K  =  0)  =  M0*)  -  p(Zg,0)  o<0*)  (3.3.80) 

*4 

as  a  convenient  expression  for  the  least  squares  estimator  of  0*  given  an  incorrect  answer  to  a  multiple-choice 
item  g. 
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The  expressions  for  the  least  squares  estimators  provided  by  (3.3.73),  (3.3.74),  (3.3.79),  and  (3.3.80) 
will  have  further  use  in  later  derivations  in  Chapter  5.  Notice  that  the  estimators  provided  by  (3.3.58)  and 
(3.3.64)  may  be  viewed  as  resulting  from  (3.3.74)  and  (3.3.80),  respectively,  under  the  simplifying  assumption 
that  /x(0*)  is  zero  and  o-2)©*)  is  unity.  In  Chapters  5  and  6,  the  primary  concern  will  be  with  estimation  under 
the  general  case,  in  particular,  the  sequential  estimation  of  O*  given  the  items  that  are  chosen  to  constitute  a 
tailored  test.  Algorithms  will  be  developed  for  tailored  testing  with  both  free-response  and  multiple-choice  items. 
But  before  these  developments  occur,  a  general  discussion  of  the  tailored  testing  process  is  in  order. 
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4.  THE  TAILORED  TESTING  PROCESS 


In  the  preceding  two  chapters,  two  normal  ogive  submodels  were  derived  from  the  model  for  a  single 
common  factor.  These  submodels  form  the  mathematical  basis  for  the  process  of  tailored  testing  in  those  particular 
instances  where  the  basic  assumptions  are  reasonable  for  an  adequate  number  of  items.  The  two-parameter 
submodel  should  be  selected  as  the  basis  for  this  process  when  a  sufficient  supply  of  free-response  items  that 
are  scored  as  either  correct  or  incorrect  is  available.  When  a  sufficient  supply  of  multiple-choice  items  that  are 
scored  as  either  correct  or  incorrect  is  available,  the  three-parameter  submodel  should  be  selected  as  the  basis 
for  this  process.  In  the  following  two  chapters,  tailoring  algorithms  for  each  of  these  submodels  will  be  derived 
with  the  aid  of  selection  theory.  These  algorithms  will  represent  the  explicit  mathematical  statements  basic  to 
the  tailoring  process.  In  the  present  chapter,  however,  concern  will  focus  on  the  less  specific:  Informal  tests  of 
the  basic  assumptions  or  the  validity  of  these  submodels  will  be  discussed;  the  requirements  of  the  tailoring 
process  will  be  delineated;  and  the  tailoring  of  an  individual  test  will  be  described. 

4.1  The  Validity  or  Adequacy  of  Fit  of  the  Normal  Ogive  Submodels 

In  assessing  the  validity  of  submodels  such  as  these,  interest  centers  on  determining  the  extent  of  agreement 
between  the  particular  submodel  and  the  observed  data.  The  extent  of  agreement  should  be  adequate.  For  instance, 
it  can  usually  be  assumed  that  given  large  enough  samples  such  submodels  will  show  some  departure  from  the 
observed  data.  What  is  required  then  is  a  degree  of  agreement  sufficient  to  produce  useful  results  upon  the 
application  of  the  particular  submodel.  That  is  to  say,  the  submodel  should  have  some  practical  value.  Major 
discrepancies  between  the  submodel  and  observed  data  would  ordinarily  be  invalidating.  Such  discrepancies 
should  severely  limit  the  usefulness  of  produced  results.  On  the  other  hand,  the  practical  implications  of  minor 
discrepancies  might  be  nonexistent. 

In  regard  to  testing  the  adequacy  of  fit  of  statistical  models,  Birnbaum  (1968)  has  offered  the  following 
observations: 

Where  specific  techniques  of  testing  fit  are  concerned,  the  reader  should  be  aware  that  some 
established  approaches  to  testing  goodness  of  fit  have  come  to  be  considered  unsound  and  poten¬ 
tially  misleading  by  a  number  of  statisticians  and  scientific  workers.  An  alternative  perspective 
on  testing  adequacy  of  models  is  one  based  primarily  on  rather  direct,  often  graphical,  comparisons 
of  data  with  significant  aspects  of  models.  Here  a  crucial  role  is  played  by  relatively  unformalized 
judgments  ....  (pp.  422-423) 

There  are  several  basic  assumptions  underlying  the  submodels  that  have  been  developed.  The  reasona¬ 
bleness  of  these  basic  assumptions  should  be  assessed  before  a  major  application  of  tailored  testing  is  initiated. 
One  basic  assumption  is  that  of  unidimensionality.  The  items  must  form  a  unifactorial  or  unidimensional  set. 
This  implies  that  the  item  error  scores  are  unique  or  independent  from  item  to  item.  As  a  result,  the  item 
covariances  should  vanish  when  ability  is  partialled  out  as  indicated  in  (1.1.14).  Another  basic  assumption,  also 
implied  in  the  basic  model  for  a  single  common  factor,  is  that  of  local  independence.  This  assumption  requires 
that  the  item  covariances  vanish  when  ability  is  held  locally  constant  as  well  as  when  ability  is  completely 
partialled  out.  A  further  basic  assumption  is  that  ability  is  normally  distributed  in  the  population  of  interest.  A 
normal  distribution  of  ability  is  assumed  in  the  model  for  a  single  common  factor.  A  final  basic  assumption  is 
that  the  regressions  of  the  binary  items  Ug  or  U'g  on  ability  are  two-  or  three-parameter  normal  ogives  depending 
on  item  type.  As  delineated  in  Chapters  2  and  3,  this  is  a  direct  consequence  of  the  assumed  bivariate  normality 
of  the  Zg  and  0  as  well  as  the  determining  relationship  between  the  Zg  and  the  Ug  and  the  Zg  and  the  Ug . 

The  Separate  Evaluations  of  Basic  Assumptions 

One  method  of  testing  the  validity  of  a  particular  submodel  might  be  to  consider  its  basic  assumptions 
as  aspects  of  significance  and  separately  assess  the  reasonableness  of  each.  While  this  method  might  be  easily 
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applied  in  the  instance  of  some  basic  assumptions,  its  application  to  others  may  be  extremely  difficult,  if  not 
impossible,  and  some  practices  in  assessing  the  reasonableness  of  the  several  basic  assumptions  have  been  both 
unsound  and  misleading. 

Unidimensionality.  The  usual  approach,  in  assessing  whether  the  assumption  of  unidimensionality  is 
reasonable,  is  to  factor  analyze  the  set  of  items.  If  a  single  common  factor  provides  an  adequate  description  of 
the  observed  data,  that  is,  if  the  sample  analogue  of  the  matrix  X(A, A)  of  (1.1.14)  is  essentially  diagonal,  then 
the  assumption  is  deemed  reasonable.  This  approach  appears  deceptively  straightforward,  but  it  is  fraught  with 
potential  for  misapplication.  The  approach  is  only  appropriate  when  free-response  items  are  being  analyzed.  In 
this  case,  the  item  intercorrelations  must  be  tetrachoric  coefficients.  The  correlation  coefficient  of  (1.1.21)  can 
be  estimated  by  a  tetrachoric  coefficient,  given  data  from  the  binary  variables  Ug  of  free-response  items.  If  phi 
coefficients  are  used  for  this  purpose  a  proliferation  of  “difficulty”  factors  can  occur  even  when  the  state  of 
nature  is  in  consonance  with  the  unidimensional  assumption.  Phi  coefficients  are  influenced  by  item  difficulties. 
When  the  state  of  nature  is  unidimensional,  sets  of  items  of  similar  difficulty  can  produce  a  spurious  multidi¬ 
mensionality.  The  approach  should  not  be  used  with  multiple-choice  items  even  with  tetrachoric  coefficients. 
The  tetrachoric  coefficient  assumes  that  the  binary  variables  arising  from  a  score  of  one  if  correct  and  a  score 
of  zero  if  incorrect  result  from  the  dichotomization  of  normal  random  variables  such  as  the  Zg.  While  this 
assumption  is  reasonable  for  free-response  items,  it  is  clearly  unreasonable  for  any  pair  of  multiple-choice  items. 
Under  the  submodel  designed  for  multiple-choice  items,  the  binary  scores  of  one  and  zero  are  not  fully  determined 
by  dichotomizations  of  the  continuous  variables  Zg.  A  brief  review  of  Figure  3.1.1  should  convince  the  reader 
of  the  unreasonableness  of  this  assumption  in  the  multiple-choice  case  when  the  three-parameter  normal  ogive 
submodel  has  been  found  to  be  valid.  Given  data  from  binary  variables  such  as  the  U'g,  the  tetrachoric  coefficient 
is  clearly  not  an  estimate  of  the  correlation  coefficient  of  (1  1.21).  A  spurious  multidimensionality  can  result 
from  the  misapplication  of  factor  analysis  to  multiple-choice  items.  This  improper  “tetrachoric  coefficient”  is 
also  influenced  by  item  difficulties. 

In  the  case  of  multiple-choice  items,  the  advocated  approach  is  to  select  items  with  high  values  of  a,. 
High  values  of  ag  indicate  strong  relationships  between  the  items  and  the  particular  dimension  of  ability.  Notice 
in  (2.2.10)  that  ag  completely  determines  p{Zg,&),  and  that  this  particular  correlation  coefficient,  in  the  usual 
factor-analytic  parlance,  is  a  factor  loading.  When  the  particular  dimension  of  ability  has  a  long  and  well- 
established  factor-analytic  pedigree,  the  values  of  ag  tend  to  be  rather  high.  In  fact,  these  values  tend  to  be  much 
higher  than  previously  thought.  Selecting  items  with  high  values  ol  ag  then  tends  toward  a  unidimensional  set 
for  the  well-established  dimensions  of  ability.  Remember,  it  is  not  essential  that  all  items  encountered  be 
adequately  represented  by  a  particular  submodel.  Adequate  representation  is  only  necessary  for  those  items 
selected  for  use  in  the  tailoring  process.  In  Section  4.2,  more  will  be  said  about  item  selection. 

Local  Independence.  Local  independence  is  a  higher  order  of  statistical  independence  than  indicated  by 
matrix  £{A,A)  of  (1.1.14),  and  is  a  state  of  nature  where  the  item  variance-covariance  matrices  are  diagonal 
matrices  for  arbitrary  values  of  ability.  That  is  to  say,  the  item  covariances  vanish  when  ability  is  held  constant. 
To  separately  assess  the  reasonableness  of  this  assumption,  therefore,  would  be  extremely  difficult  if  not  im¬ 
possible.  In  latent  trait  applications,  one  is  usually  limited  to  finite  samples  of  examinees  as  well  as  to  estimates 
of  ability.  A  difficult  problem,  then,  is  the  size  of  subsamples  when  the  estimate  of  ability  is  held  constant. 
Another  difficult  problem  is  that  true  ability  is  not  fixed  when  estimates  of  ability  are  held  constant.  Thus,  the 
appropriate  variance-covariance  matrices  for  use  in  assessing  the  reasonableness  of  this  assumption  are  usually 
not  obtainable  in  practice.  That  the  sample  analogue  of  the  matrix  X(A,A)  of  (1.1.14)  be  essentially  diagonal  is 
a  necessary  condition  given  the  reasonableness  of  the  assumption  of  local  independence.  However,  this  condition 
in  and  of  itself  is  not  sufficient  to  establish  the  reasonableness  of  this  basic  assumption. 

Normally  Distributed  Ability.  The  assumption  of  normally  distributed  ability  is  almost  always  reasonable. 
In  fact,  it  is  difficult  to  construct  tailored  tests  under  the  procedures  advocated  in  this  report  that  wdl  be  inconsistent 
with  this  assumption.  In  Table  5.3.1,  for  example,  data  will  be  presented  which  indicate  that  the  assumption  of 
normality  provides  a  very  workable  approximation  even  when  the  distributions  of  ability  are  known  to  be 
nonnormal. 

If  the  distributions  of  ability  estimates  are  examined  to  assess  normality,  the  nature  of  the  estimates  must 
be  kept  in  mind.  When  ability  is  estimated  by  the  algorithms  of  Section  6.2  and  6.3,  the  estimates  are  approximate 
least  squares  or  regressed  estimates.  One  should  ensure  that  these  estimates  can  be  expected  to  form  a  linear 
regression  on  the  Zg.  Only  under  this  condition  will  the  form  of  the  distribution  of  ability  estimates  reflect  that 
of  the  distribution  of  true  ability.  This  condition  is  ensured  by  terminating  each  tailored  test  when  the  error  of 
the  ability  estimate  is  at  most  some  constant.  Given  a  constant  terminal  error,  the  mean  and  variance  of  the 
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distribution  of  ability  estimates  can  also  be  predicted.  A  detailed  consideration  will  be  given  to  the  termination 
of  tailored  tests  in  Chapter  7. 

Normal  Ogive  Regressions.  Given  these  submodels,  normal  ogive  regressions  of  binary  items  on  estimates 
of  ability  can  be  expected  when  the  terminal  error  is  held  constant  for  each  tailored  test.  If  the  distribution  of 
estimates  of  ability  departs  significantly  from  the  distribution  of  true  ability,  these  regressions  can  also  depart 
significantly  from  their  true  form,  In  this  context,  tests  of  goodness  of  fit  should  be  considered  unsound  and 
potentially  misleading,  for  two  reasons.  Normal  ogive  regressions  are  not  expected  when  the  distributional  forms 
of  estimates  of  ability  and  true  ability  depart  significantly;  and  minor  discrepancies  from  assumed  regressions 
may  have  insignificant  practical  implications.  Minor  discrepancies  are  easily  detected  given  large  enough  samples. 

In  order  to  assess  the  reasonableness  of  this  basic  assumption  for  a  particular  submodel,  graphs  of  the 
sample  analogues  of  these  regressions  can  be  visually  inspected.  The  conditions  under  which  the  true  forms  of 
these  regressions  are  to  be  expected  should  be  kept  in  mind.  The  graphs  for  free-response  items  should  be 
represented  reasonably  well  by  two-parameter  normal  ogives;  whereas  three-parameter  normal  ogives  should 
represent  these  graphs  reasonably  well  for  multiple-choice  items. 

The  Alternative  Perspective 

Another  method  of  testing  the  validity  of  a  particular  submodel  is  to  consider  significant  aspects  of 
practical  value.  In  this  case,  results  of  practical  importance  are  predicted.  These  predictions  are  derived  or  inferred 
from  the  submodel.  Thus,  they  depend  on  the  reasonableness  of  all  of  the  basic  assumptions.  The  predictions 
are  then  subjected  to  disconfirmation  using  observed  data.  If  the  predicted  results  are  obtained,  the  basic 
assumptions  are  considered  reasonable.  If  the  predicted  results  are  discontinued,  then  the  basic  assumptions  are 
considered  unreasonable.  Normally,  this  method  is  applied  only  after  several  of  the  basic  assumptions  have  been 
assessed  as  reasonable. 

An  example  of  the  application  of  this  method  has  been  reported  in  the  literature  (Urry,  1977,  pp.  188- 
190).  Accepting  all  of  the  basic  assumptions  of  the  three-parameter  submodel  as  the  true  state  of  nature,  the 
investigator  predicted  some  eight  correlations  between  distinct  measures  of  the  same  ability.  These  predictions 
were  for  correlations  between  eight  ability  estimates  resulting  from  tailored  testing  to  eight  different  levels  of 
reliability  and  the  test  score  from  a  written  test  of  known  reliability.  A  pilot  study  of  tailored  testing  was  then 
conducted.  In  each  of  the  eight  cases,  the  obtained  correlation  exceeded  in  numerical  value  the  corresponding 
predicted  correlation.  As  a  consequence,  it  may  be  concluded  that  the  three-parameter  normal  ogive  submodel, 
given  all  of  its  basic  assumptions,  is  valid  for  use  with  multiple-choice  items.  In  Chapter  7,  the  theoretical  basis 
for  the  prediction  of  these  correlations  will  be  derived  and  discussed. 

Aside  from  the  important  implication  for  validity,  a  practical  implication  drawn  in  the  cited  literature  for 
tailored  testing  with  this  submodel  was  that  the  levels  of  predicted  reliability  could  be  achieved  with  dramatic 
reductions  in  the  number  of  required  items  vis-a-vis  conventional  paper-and-pencil  testing.  The  observed  reduc¬ 
tions  were  of  the  order  of  80  percent.  The  practical  importance  of  these  reductions  is  principally  economic. 
Fewer  tailored  testing  stations,  at  a  given  cost,  are  required  to  sustain  an  established  testing  volume.  Given  this 
established  volume,  the  amount  of  use  of  testing  stations,  and  therefore  their  number,  depends  primarily  on 
testing  time,  which  bears  a  direct  relationship  to  test  length. 


4.2.  Requirements  of  the  Tailored  Testing  Process 

Given  the  validity  or  adequacy  of  fit  of  a  particular  submodel,  a  successful  application  of  the  tailoring 
process  depends  on  (a)  accurate  estimates  of  the  item  parameters  and  (b)  an  appropriate  selection  of  items  for 
the  ability  bank. 


Accurate  Estimates  of  the  Item  Parameters 

In  the  developments  thus  far  it  has  been  assumed  that  the  item  parameters — either  ag  and  bg  in  the  case 
of  the  two-parameter  normal  ogive  submodel  or  ag9  bg9  and  cg  in  the  case  of  the  three-parameter  normal  ogive 
submodel — are  known.  In  practice,  these  parameters  need  to  be  estimated.  Accuracy  in  estimating  the  item 
parameters  depends  on  both  the  number  of  items  and  the  number  of  examinees  in  the  analyzed  data  sets.  If 
applications  of  tailored  testing  are  anticipated,  one  should  ensure  that  adequate  data  are  available  for  this  purpose. 
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Algorithms  for  the  estimation  of  item  parameters  will  be  presented  in  a  subsequent  report.  The  basic 
assumptions  of  these  algorithms  are  identical  to  those  underlying  the  normal  ogive  submodels  discussed  here. 
Simulation  techniques  will  be  considered  that  will  allow  an  evaluation  of  the  accuracy  of  item  parameter  estimates. 

Notice  that  the  expressions  derived  for  the  submodels  in  Chapters  2  and  3,  as  well  as  those  yet  to  be 
derived,  all  assume  or  will  assume  that  the  item  parameters  are  known.  Predictions  drawn  from  these  submodels, 
then,  also  assume  knowledge  of  the  item  parameters;  and  predictions  of  this  type  will  become  an  integral  pail 
of  the  tailoring  process.  Thus,  accurate  estimation  or  reasonable  knowledge  of  the  item  parameters  is  essential. 

An  Appropriate  Selection  of  Items  for  the  Ability  Bank 

The  item  parameters  are  usually  estimated  with  ability  scaled  to  a  mean  of  zero  and  a  variance  of  unity. 
Thus  one  usually  has  estimates  of  ag,  bg,  and,  in  the  case  of  the  three-parameter  normal  ogive  submodel,  c  of 
equations  (2. 1.12),  (2  1 .13), and  (3.1.17),  respectively.  Item  selection  is  best  made  on  the  basis  of  these  estimates. 
Later,  these  estimates  may  be  transformed  to  a*,  b*,  and,  in  the  case  of  the  three-parameter  normal  ogive 
submodel,  c*,  by  means  of  equations  (2.2.17),  (2.2. 18), and  (3.2.14),  respectively,  when  a  mean  and  variance 
have  been  prescribed  for  the  scale  of  ability. 

In  item  selection,  there  are  three  primary  goals:  (a)  to  construct  an  item  bank  where  the  constituent  items 

are  adequately  represented  by  a  particular  submodel  and  consequently  measure  a  single  dimension  of  ability _ 

hence  the  designation  ability  bank;  (b)  to  obtain  constituent  items  for  the  ability  bank  such  that  their  required 
numbers  in  achieving  given  levels  of  reliability  through  tailored  testing  is  reduced  relative  to  the  item  requirements 
of  conventional  paper-and-pencil  testing:  and  (c)  to  obtain  constituent  items  for  the  ability  bank  such  that  the 
estimates  of  ability  obtained  for  all  examinees  can  be  essentially  equiprecise,  that  is,  the  error  in  ability  estimation 
at  the  termination  of  tailored  testing  can  be  essentially  constant  for  all  examinees. 

In  Section  4.1,  several  methods  of  evaluating  the  adequacy  of  fit  of  these  submodels  to  item  data  were 
discussed.  To  obtain  the  first  goal  in  item  selection,  then,  the  methods  prescribed  in  that  section  should  be 
applied.  The  application  of  the  unprescribed  methods,  that  are  known  to  be  unsound  and  potentially  misleading, 
should  be  avoided. 

To  obtain  the  second  goal,  one  needs  to  select  items  with  high  values  of  ag  and,  in  the  case  of  the  three- 
parameter  normal  ogive  submodel,  low  values  of  cg.  In  both  cases,  the  bg  must  be  evenly  and  widely  distributed. 

It  has  been  demonstrated  (Urry,  1970,  1977)  that  a  minimum  value  of  .8  should  be  set  for  the  a ,.  This 
minimum  value  ensures  that  tailored  testing  will  be  more  economical  in  item  usage  than  conventional  testing  in 
achieving  the  same  level  of  reliability.  Higher  values  of  ag  improve  this  economic  outlook.  When  the  regressions 
of  the  binary  items  on  ability  are  essentially  linear,  the  test  score  of  conventional  testing,  the  number  of  correct 
items,  cannot  be  improved  on  in  this  regard.  It  is  only  when  these  regressions  become  markedly  curvilinear,  or 
when  ag  exceeds  .8  in  value,  that  dramatic  reductions  in  the  number  of  required  items  can  be  realized  through 
tailored  testing.  Under  the  two-parameter  normal  ogive  submodel,  the  biserial  correlation  between  a  free-response 
item  and  a  perfectly  reliable  conventional  test  is  about  .62  when  ag  is  .8,  irrespective  of  the  item’s  difficulty. 
However,  given  the  three-parameter  normal  ogive  submodel  and  ag  equal  to  .8,  the  biserial  correlation  between 
a  multiple-choice  item  and  a  perfectly  reliable  conventional  test  varies  with  the  item’s  difficulty  as  well  as  with 
cg,  the  item’s  coefficient  of  guessing.  For  any  nonzero  cg,  the  value  of  this  biserial  correlation  is  less  for  difficult 
items  than  for  easy  items.  Since  success  due  to  guessing  occurs  with  greater  frequency  on  difficult  items  than 
on  easy  items,  its  masking  effect  on  item  discriminatory  power  as  indexed  by  the  biserial  correlation  is  more 
pronounced  for  difficult  items  than  for  easy  items.  When  ag  is  .8  and  cg  is  .20,  this  biserial  correlation  is  about 
.26  for  very  difficult  items  and  about  .59  for  very  easy  items  (Urry,  1976).  Since  this  biserial  correlation  is  also 
attenuated  by  unreliability  in  the  conventional  test,  experience  with  the  biserial  correlation  in  conventional  item 
analysis  should  lead  one  to  conclude  that  obtaining  multiple-choice  items  where  ag  is  at  least  .8  is  a  far  easier 
task  than  is  commonly  thought. 

High  values  of  cg  have  adverse  effects  on  the  tailored  testing  process.  The  gain  per  item  in  precision  is 
lessened  in  sequential  ability  estimation.  Thus,  multiple-choice  items  having  more  rather  than  fewer  alternatives 
are  desirable.  As  a  rule  of  thumb,  a  maximum  value  of  .3  is  suggested  for  the  cg,  where  cg  is  somewhat  related 
to,  but  not  fixed  by  the  number  of  item  alternatives. 

The  item  difficulties,  the  bg,  should  be  distributed  in  a  fashion  that  will  allow  redundant  challenge  at  all 
levels  of  ability  in  the  population  of  interest.  Redundancy  is  required  in  order  to  obtain  equal  precision  in  ability 
estimation  for  the  full  range  of  ability  in  this  population.  The  distribution  of  bg,  then,  should  be  evenly  and 
widely  distributed.  How  evenly  and  widely  distributed  depends  on  the  degree  of  precision  or  reliability  required 
of  ability  estimates,  which  brings  one  to  the  third  goal. 
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Consideration  of  the  third  goal  requires  a  clearer  definition  of  reliability  in  the  tailored  testing  context. 
The  process  of  tailored  testing  produces  as  many  tests  as  there  are  examinees.  Each  test  is  tailored  to  an  examinee 
of  given  ability.  In  this  context,  reliability  is  a  property  of  the  estimates  of  ability  resulting  from  the  process. 
In  the  conventional  context  of  paper-and-pencil  testing,  reliability  is,  by  way  of  contrast,  a  property  of  a  specific 
printed  form  of  the  test. 

An  index  of  reliability  for  the  estimates  of  ability  resulting  from  the  tailoring  process  will  be  derived  in 
Chapter  7.  As  will  be  seen,  this  index  represents  a  binary  analogue  of  the  squared  multiple  correlation.  It  possesses 
the  following  similarities  to  reliability  in  classical  test  theory:  (a)  this  index  represents  the  correlation  between 
equiprecise  estimates  of  the  same  ability  which  is  analogous  to  the  correlation  between  parallel  forms  in  the 
classical  setting,  and  (b)  the  square  root  of  this  index  represents  the  correlation  between  equiprecise  ability 
estimates  and  true  ability,  which  is  analogous  to  the  correlation  between  test  scores  and  true  score. 

The  use  of  this  index  assumes  constant  conditional  variances  of  0*  given  the  tailored  tests.  As  mentioned 
earlier,  this  constancy  ensures  that  the  estimates  of  ability  form  a  linear  regression.  A  linear  regression  can  be 
approximated  by  terminating  each  tailored  test  w'hen  the  error  of  the  ability  estimate  is  equal  to  or  less  than  a 
prespecified  constant.  Given  this  prespecified  constant  ,  a  lower  bound  to  this  index  of  reliability  can  be  calculated. 
This  calculation  is  possible  because  appropriate  termination  guarantees  that  the  error  in  ability  estimation  is  at 
most  equal  to  the  prespecified  constant.  As  the  prespecified  constant  becomes  smaller,  or  as  the  achieved 
termination  rule  becomes  more  stringent,  the  error  in  ability  estimation  more  closely  approaches  this  prespecified 
constant.  The  smaller  the  prespecified  constant  is  set,  the  longer  each  tailored  test  must  be  in  order  to  achieve 
the  termination  rule;  and  the  change  per  item  in  the  error  of  ability  estimation  decreases  with  tailored  test  length. 
Thus  the  longer  the  tailored  test,  the  more  closely  the  error  in  ability  estimation  approaches  the  prespecified 
constant.  As  the  expected  value  of  the  error  in  ability  estimation,  taken  over  the  tailored  tests,  approaches  the 
prespecified  constant,  tailored  test  reliability  approaches  the  lower  bound  to  the  index  of  reliability.  The  lower 
bound  to  the  index  of  reliability  will  be  discussed  in  Chapter  7.  Its  calculation  allows  a  forecast  of  tailored  test 
reliabilities  before  the  process  of  tailored  testing  begins. 

There  is  an  important  condition.  The  prespecified  constant  must  be  reached  at  termination  in  each  tailored 
test.  Achieving  this  condition  depends  on  the  value  of  the  prespecified  constant  and  on  the  configuration  of  item 
parameters  in  the  ability  bank.  If  higher  levels  of  precision  or  reliability  are  necessary,  closer  spacing  is  required 
between  the  item  difficulties.  In  turn,  this  requirement  calls  for  an  increase  in  the  number  of  items  in  the  ability 
bank.  In  order  to  determine  the  performance  of  the  ability  bank  in  regard  to  achieving  desired  tailored  test 
reliabilities,  simulation  studies  (Urry,  1974,  1976,  1977)  should  be  conducted.  For  a  set  of  multiple-choice  items, 
such  simulation  studies  consist  of  applying  the  tailored  testing  algorithm  presented  in  Section  6.2  for  the  three- 
parameter  normal  ogive  submodel  to  binary  item  data  that  has  been  generated  from  this  submodel.  The  generation 
of  binary  item  data  given  this  submodel  will  be  discussed  in  Section  11.1.  But  briefly,  in  this  generation  process, 
the  estimates  of  the  parameters  a A,,  b and  c#  for  the  items  in  a  particular  ability  bank  are  used.  As  a  part  of 
this  process,  values  of  true  ability  are  sampled  from  the  distribution  assumed  for  0.  Thus,  the  values  of  true 
ability  are  known.  Estimates  of  ability  can  then  be  obtained  through  tailored  testing  with  the  algorithm  given 
data  for  items  with  the  parametric  configuration  of  this  particular  ability  bank  and  the  assumed  distribution  of 
ability.  The  estimates  of  ability  obtained  under  certain  termination  rules  can  then  be  correlated  with  the  known 
values  of  the  ability.  Since  the  squared  correlation  between  the  estimates  of  ability  and  the  known  values  of 
ability  defines  tailored  test  reliability,  one  can  determine  how  well  tailored  test  reliability  is  forecasted  from  the 
termination  rules  as  well  as  how  stringent  the  termination  rule  can  be  made,  such  that  the  prespecified  constant 
can  still  be  achieved  in  the  tailored  testing  of  individuals  with  this  specific  ability  bank.  Simulation  studies  such 
as  these  allow  an  assessment  as  to  the  achievability  of  tailored  test  reliabilities  given  the  parametric  configuration 
of  a  specific  ability  bank. 

Subject  to  revision  through  the  interpretation  of  results  from  simulation  studies,  it  is  suggested  that  item 
difficulties  be  evenly  distributed  on  the  interval  from  —2.0  to  2.0,  and  that  the  total  number  of  items  be 
approximately  100.  Given  the  ability  estimation  techniques  provided  in  this  report,  a  wider  distribution  of  item 
difficulties  and  a  greater  number  of  items  are  required  when  higher  levels  of  reliability,  say  those  in  excess  of 
.95,  are  deemed  necessary. 

4.3  Tailoring  the  Individual  Test 

In  the  present  section  general  features  of  the  tailoring  process  will  be  described.  In  Chapters  5  and  6, 
the  formal  mathematical  statements  or  basic  algorithms  for  this  process  will  be  derived  for  both  the  two-  and 
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three-parameter  normal  ogive  submodels.  As  will  be  seen  later,  tailored  testing  is  best  implemented  as  a  computer- 
interactive  process  because  of  a  requirement  for  extensive  mathematical  calculation.  This  requirement  will  become 
apparent  in  Chapter  8,  where  a  numerical  illustration  of  an  individually  tailored  test  is  provided. 

From  the  perspective  of  the  individual,  the  tailoring  process  involves  the  following:  the  individual  is 
seated  in  front  of  a  microcomputer.  Instructions  on  the  proper  use  of  this  equipment  are  provided  on  its  cathode 
ray  tube,  or  television-like  screen.  The  instructions  elicit  series  of  actions.  When  the  elicited  actions  indicate 
the  individual’s  complete  understanding  of  what  this  situation  requires,  the  test  begins.  A  test  item  appears  on 
the  cathode  ray  tube,  and  the  individual  provides  an  answer  on  the  typewriter-like  keyboard  of  this  microcomputer. 
If  the  answer  given  is  correct,  the  next  item  will  be  more  difficult.  If  the  answer  given  is  not  correct,  an  easier 
item  will  follow.  The  process  continues  in  similar  fashion  until  a  message  on  the  cathode  ray  tube  indicates  that 
testing  has  been  concluded. 

The  overall  goal  of  tailored  testing  is  to  obtain  equally  precise  estimates  of  ability  In  obtaining  this  goal, 
the  process  has  a  scenario  that  is  constant  from  individual  to  individual.  The  general  scenario  unfolds  as  follows: 
An  individual  known  to  be  a  member  of  the  population  of  interest  is  to  be  tested.  Given  what  is  known  about 
this  individual,  the  least-squares  estimate  of  ability  is  the  mean  of  ability,  /u(0*),  and  its  squared  error,  the 
variance  of  ability,  is  or(9*).  These  prior  estimates,  ju (0*)  and  cr{6*),  are  then  used  to  initiate  the  following 
iterated  sequence: 

1.  Given  the  current  estimate  of  ability  and  its  variance,  the  most  informative  item  is  chosen  from  the 
ability  bank; 

2.  This  item  is  presented  on  the  cathode  ray  tube; 

3.  The  individual  responds  by  way  of  the  keyboard; 

4.  The  response  is  scored; 

5.  A  revised  estimate  of  ability  is  obtained; 

6.  Its  variance  is  estimated; 

7.  The  square  root  of  this  variance,  the  error  of  the  estimate  of  ability,  is  compared  to  a  prespecified 
constant; 

8.  If  the  error  of  the  ability  estimate  is  equal  to  or  less  than  the  prespecified  constant,  the  test  is  terminated; 

9.  Otherwise,  the  sequence  is  repeated 

The  sequence  is  repeated  until  the  condition  in  Step  8  is  satisfied.  Satisfaction  of  Step  8  has  important 
implications  with  respect  to  the  linearity  of  regression  of  the  ability  estimates  and  the  reliability  of  the  tailored 
testing  process.  The  development  of  the  algebraic  intricacies  in  the  applications  of  this  general  scenario  requires 
the  further  derivation  provided  in  the  following  two  chapters. 

For  this  later  development,  it  is  important  to  distinguish  two  necessary  systems  of  item  subscription.  The 
items  in  the  ability  bank  are  subscripted  g,  where  g  =  1,  2,...  p.  These  items  are  then  chosen  from  the  ability 
bank  as  in  Step  1  to  form  the  individualized  sequence  that  becomes  the  tailored  test.  Within  a  tailored  test,  the 
items  chosen  from  the  ability  bank  are  subscripted  in  sequential  order  by  n,  where  n  =  1,2,  ...  q-  In  this 
context,  q,  is  the  number  of  repetitions  of  the  iterated  sequence  for  individual  i.  The  number  of  items  required 
to  satisfy  Step  8,  thus  terminating  the  iterations,  can  vary  with  individuals.  Variability  in  tailored  test  length  is 
necessary  to  insure  that  the  degree  of  precision  imposed  by  Step  8  is  constant  across  individuals.  For  instance, 
fewer  items  are  required  for  individuals  of  average  ability  than  are  required  for  individuals  of  high  ability  to 
achieve  termination  in  Step  8. 
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5.  PRELIMINARY  DEVELOPMENTS  FOR  THE 
TAILORED  TESTING  ALGORITHMS 


5.1.  The  Selection  or  Rejection  Analogy 

In  this  chapter,  selection  theory  is  used  as  a  basis  for  the  development  of  the  tailored  testing  algorithms. 
The  relevance  of  this  theory  can  be  established  by  analogy.  In  Chapters  2  and  3,  the  two-  and  three-parameter 
normal  ogive  submodels  were  distinguished  from  one  another  on  the  basis  of  the  hypothetical  relationships 
between  the  continuous  random  variables  Zg  and  the  binary  random  variables  Ug  or  U'g.  As  portrayed  in  Figure 
2.1.1  and  Figure  3.1.1,  the  Zg  determine  the  Ug  and  U'g.  The  manner  of  this  determination  is  the  characteristic 
distinguishing  between  these  submodels.  These  hypothetical  relationships  are  now  viewed  from  a  selection 
perspective.  One  should  remember  that  the  Zg  are  not  observed,  although  as  described  in  Chapters  2  and  3,  they 
might  be.  The  observed  Ug  and  U'g,  derive  from  the  unobserved  Zg.  In  tailored  testing,  one  might  view  the 
process  as  though  binary  scores,  which  are  the  realizations  of  Ug  or  Ug,  indicate  explicit  selection  on  the  continuous 
variable  Zg.  That  is  to  say,  binary  scoring  is  analogous  to  explicit  selection  or  explicit  rejection  on  a  specific 
continuous  variable  Zg.  The  similarity  is  not  complete  because  the  “cut  score”,  yg,  cannot  be  changed  on  a 
particular  Zg.  The  approach  then,  has  to  be  one  of  identifying  and  choosing  a  particular  item  g  that  has  a 
desirable  “cut  score,”  yg.  This  feature  of  the  submodels  introduces  the  requirement  for  a  sufficient  supply  of 
items  in  order  to  allow  adequate  flexibility  in  choosing  the  “cut  scores,”  the  -y 

Under  the  analogy,  the  correspondence  between  the  binary  scoring  of  an  item  and  explicit  selection  or 
rejection  on  the  continuous  variable  Zg  can  be  delineated  as  well  as  illustrated.  For  the  two-parameter  submodel, 
the  realization  ug  equal  to  one  is  the  analogue  of  an  explicit  selection  on  Zg  of  that  subpopulation  with  a  free- 
response  score,  £gio,  equal  to  or  greater  than  a  “cut  score,”  yg.  Similarly,  the  realization  ug  equal  to  zero  is  the 
analogue  of  explicit  rejection  on  Zg  of  that  subpopulation  with  free-response  scores,  £gi<„  less  than  a  “cut  score,” 
yg.  These  analogous  relationships  may  be  reviewed  by  consulting  the  shaded  and  unshaded  areas  of  Z  in  Figure 

21.1.  * 

Explicit  selection  and  explicit  rejection  on  ZA,  as  indicated  by  the  realization  of  U'g  for  the  three -parameter 
submodel,  under  the  same  analogy,  are  somewhat  more  complicated.  The  realization  equal  to  one  is  the 
analogue  of  explicit  selection  on  Zg  of  that  subpopulation  with  recognition  scores,  £gio,  equal  to  or  greater  than 
a  “cut  score,”  yg,  plus  a  random  proportion  cg  of  that  subpopulation  with  recognition  scores,  £  •„,  less  than  a 
“cut  score,”  yg.  This  method  of  explicit  selection  is  indicated  by  the  shaded  area  of  Zg  as  presented  in  Figure 
3.1.1.  Similarly,  the  realization  u'g  equal  to  zero  is  the  analogue  of  explicit  rejection  on  Zg  of  the  remaining 
proportion,  (1  -  cg ),  of  that  subpopulation  with  recognition  scores,  £gio,  less  than  a  “cut  score,”  y  .  This 
method  of  explicit  rejection  is  graphically  indicated  by  the  unshaded  area  of  Zg  as  presented  in  Figure^ 3. 1.1. 
These  analogous  relationships  support  the  relevance  of  selection  theory  for  further  developments. 

It  was  mentioned  earlier  that  items  are  sequentially  chosen  from  the  ability  bank  to  construct  each  tailored 
test.  In  sequence,  each  choice  obtains  the  most  informative,  available  item  g  given  the  current  information  on 
the  individual.  From  this  perspective,  a  tailored  test  is  analogous  to  a  series  of  explicit  selections  and  explicit 
rejections  indicated  by  an  outcome  vector  containing  the  individual’s  binary  scores  on  the  most  informative  items 
from  the  ability  bank.  The  mean  ability  score  for  the  subpopulation  that  would  have  been  obtained  given  the 
series  of  explicit  selections  and  explicit  rejections  is  taken  as  the  estimator  of  the  individual’s  ability.  Under  the 
analogy,  the  variance  of  this  estimator  is  the  restricted  variance  of  ability  for  the  subpopulation  that  would  have 
been  obtained  by  the  associated  series  of  incidental  selections  and  incidental  rejections  on  the  variable  of  ability 
as  indicated  by  the  outcome  vector  of  binary  scores.  This  variance  is  the  variance  of  ability  given  restriction  in 
range,  the  effect  of  the  incidental  selections  and  rejections.  In  this  context,  restriction  in  range  is  desirable.  It 
denotes  precision  in  ability  estimation. 

Viewed  from  the  perspective  of  the  analogy,  the  sequential  choice  of  items  produces  a  series  of  explicit 
selections  and  rejections  resulting  in  the  identification  of  a  subpopulation  that  is  relatively  homogeneous  with 
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respect  to  the  variable  of  ability.  That  is  to  say,  items  are  sequentially  chosen  in  order  to  restrict  most  severely 
the  variance  and  thus  the  range  of  ability  associated  with  a  particular  outcome  vector  of  binary  scores  indicating 
explicit  selections  and  rejections  on  a  series  of  Zn. 

In  Section  5.2,  a  general  expression  will  be  developed  for  the  choice  of  the  most  informative  items  from 
the  ability  bank.  It  will  be  established  that  the  chosen  items  are  the  most  informative  items  to  use  in  the  construction 
of  the  particular  tailored  test.  In  Section  5.3,  some  important  developments  are  derived  from  selection  theory. 
These  developments  will  provide  the  needed  input  for  the  recursive  formulation  of  the  tailoring  algorithms  to  be 
presented  in  Chapter  6.  In  Sections  6.2  and  6.3,  the  tailoring  algorithms  for  the  two-  and  three-parameter  normal 
ogive  submodels  will  be  summarized  from  earlier  developments,  mainly  those  of  Section  5.3. 

In  the  following  discussion,  it  is  assumed  that  “incidental  selection'5  and  “incidental  rejection”  with 
respect  to  the  variable  of  ability  result  in  a  normal  distribution  of  ability.  This  assumption  represents  a  very 
workable  approximation  allowing  the  sequential  estimation  of  ability  and  its  variance.  Sequential  estimation 
under  this  assumption  is  generally  referred  to  as  a  restricted  updating  procedure. 

5.2  The  Sequential  Choice  of  Items 

In  this  context,  items  are  chosen  by  the  tailoring  algorithm.  Item  selection,  as  discussed  in  Section  4.2, 
consisted  of  the  choosing  of  items  by  the  practitioner.  This  item  selection  produces  an  effective  ability  bank  of 
manageable  size.  Since  items  are  later  chosen  by  the  algorithm,  one  can  usually  further  reduce  the  size  of  the 
ability  bank.  This  reduction  can  be  accomplished  by  eliminating  those  items  never  chosen  by  the  algorithm  when 
the  population  of  interest  is  being  tested  to  the  required  level  of  reliability.  This  process  of  elimination  does  not 
influence  the  effectiveness  of  the  ability  bank,  but  renders  its  size,  that  is,  its  number  of  items,  more  manageable 
in  a  microcomputer  environment. 

It  was  mentioned  earlier  that  the  goal  of  tailored  testing  was  to  obtain  equally  precise  estimates  of  ability. 
Within  the  individually  tailored  test,  the  emphasis  is  on  precision.  Under  the  analogy,  restriction  in  the  range 
of  ability  is  the  corollary  of  tailored  test  precision.  Thus,  the  most  informative,  available  item  is  the  one  that 
will  most  restrict  the  range  of  ability  associated  with  its  estimate,  or,  synonomously,  render  the  most  precise 
estimate  of  ability  In  this  context  an  item  is  referred  to  as  available  when  it  has  not  yet  been  used  in  the  tailoring 
of  a  test  for  the  particular  individual.  Once  the  designated  level  of  precision  has  been  achieved,  the  tailored  test 
is  terminated.  Equality  of  precision  is  then  enforced  through  the  appropriate  termination  of  the  tailored  tests  for 
all  individuals. 

In  constructing  the  sequence  of  items  for  a  tailored  test,  each  item  is  chosen  on  the  basis  of  the  expectation 
that  the  individual's  answer  to  that  particular  item  will  restrict  the  variance  of  ability  for  the  associated  estimate 
more  than  will  the  individual’s  answer  to  any  other  available  item  in  the  ability  bank.  Thus,  an  expected  value 
for  the  variance  of  ability  is  involved.  In  determining  the  most  informative,  available  item,  this  expected  value 
is  evaluated  for  each  of  the  available  items.  One  seeks  the  item  with  the  minimum  value  because  it  is  desired 
to  restrict  this  variance  most  severely  given  a  sequence  of  available  items.  Alternatively,  one  might  state  that  it 
is  desired  to  arrive  at  the  designated  level  of  precision  with  the  sequence  that  consists  of  as  few  items  as  possible 
given  those  available.  The  cumulative  effect  across  all  tailored  tests  is  that  this  method  of  choosing  items  is 
expected  to  achieve  the  designated  level  of  reliability  for  the  “scores”  obtained  from  the  tailoring  process  with 
as  few  items  as  possible  given  the  particular  ability  bank. 

One  begins  by  choosing  the  first  item.  It  is  known  that  the  individual  being  tested  is  a  member  of  the 
population  of  interest.  One’s  estimate  of  this  individual’s  ability  is,  then,  /x(0*),  and  the  variance  of  this  estimate 
is,  then,  tr2^*).  One  knows  the  item  parameters  and  b* ,  in  the  two-parameter  case,  or  a* ,  £>£ ,  and  c* ,  in 
the  three-parameter  case.  A  formula  for  the  expected  value  of  the  variance  of  ability  is  now  needed  which 
anticipates  the  probable  outcomes  of  the  encounter  between  this  individual  and  each  item  g  in  the  ability  bank. 
For  convenience  in  ' exposition,  this  expected  value  will  be  generalized  with  respect  to  the  submodels.  The 
statistical  rationale  basic  to  choosing  the  item  is  shared  by  both  submodels.  In  the  following  section,  submodel 
specificity  will  be  provided  in  the  form  of  computationally  convenient  identities  of  this  generalized  expected 
value.  The  purpose  in  this  subsection  is  to  provide  the  common  statistical  rationale  in  explicit  form. 

Let  U*  be  designated  as  a  generalized  binary  random  variable  denoting  either  Ug  or  U's  depending  on  the 
submodel  context.  The  generalized  expected  value  for  the  choice  of  the  first  item,  then,  is 

%Uf  <x2(0*  |  U*)  -  Pr(«*  =  1)  cr2(0*  |  w*  =  1)  +  Pr(w*  =  0)  o-2(0*  |  w*  =  0)  (5.2.1) 

where  Pr(w*  =  1)  and  Pr(w*  =  0)  are  merely  the  respective  probabilities  of  a  correct  and  incorrect  answer  to 
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item  g  given  what  is  currently  known  about  this  individual,  and  0^(0*  |  w*  =  1)  or  0^(0*  |  w*  =  0)  is  the 
variance  of  ability  given  either  of  the  two  probable  outcomes,  a  correct  answer  or  an  incorrect  answer  to  item 
g -  This  expected  value  is  merely  a  weighted  sum,  the  sum  of  weighted  variances.  Prior  to  summation,  the 
weights,  the  probabilities  of  the  particular  outcomes,  are  each  multiplied  by  the  variance  associated  with  the 
particular  outcome. 

In  choosing  the  first  item,  a  submodel-specific  and  computationally  convenient  identity  of  (5.2.1)  (to  be 
provided  in  Section  5.3)  is  actually  employed.  Each  item  in  the  ability  bank  is  evaluated.  The  item  g  that  yields 
the  minimum  value  for  the  expected  variance  is  chosen  as  the  first  item  in  the  tailoring  sequence.  This  item  g 
is  designated  as  item  g0)  to  indicate  that  this  item  g  was  chosen  as  the  first  item  in  the  tailoring  sequence.  Such 
superscription  cross-references  the  item  as  indexed  within  the  ability  bank  as  the  first  item  in  the  tailored  test. 
Items  within  the  tailored  test  are  sequentially  ordered  by  the  subscript  n.  For  this  particular  item  g,  g{l\  its 
subscript  within  the  tailored  test,  then,  is  1.  According  to  the  statistical  rationale  of  the  choice  of  this  item,  the 
item  is  by  expectation  the  most  informative.  The  information  yielded  by  the  binary  score  for  this  particular 
individual  on  this  particular  item  is  expected  to  provide  the  most  severe  restriction  in  the  variance  of  ability  or, 
synonomously,  to  result  in  the  most  precise  estimate  of  this  individual’s  ability  given  the  items  in  the  ability 
bank. 

To  provide  submodel  specificity  for  (5.2.1),  one  should  note  that  U*  has  the  following  realizations: 

For  the  two-parameter  submodel, 
ug  =  1  (answer  correct) 
and 

ug  =  0  (answer  incorrect); 

For  the  three-parameter  submodel, 
ug  =  1  (answer  correct) 
and 

u'g  =  0  (answer  incorrect). 

Thus,  for  the  two-parameter  normal  ogive  submodel,  substitutions  from  (2.2.1)  and  (2.2.3)  into  (5.2.1)  yield 

'Zv*  a2(e*  I  Uk)  =  PH  0^(0*  I  Ug  =  1)  +  Qg  a 2(0*  I  Ug  =  0);  (5.2.2) 

and  substitutions  from  (3.2.1)  and  (3.2.2)  into  (5.2.1)  provide 

%ui  o-2(0*  I  Ug)  =  P'g  cr2(6*  |  u'g  =  1)  +  Qg  a2(G*  \  u'g  =  0)  (5.2.3) 

for  the  three-parameter  normal  ogive  submodel.  Subscripts  on  the  various  terms  for  individual  i  are  omitted 
because  such  subscription  is  implied  by  context.  In  (5.2.2)  and  (5.2.3),  submodel  specificity  is  present,  but 
computational  convenience  awaits  the  further  developments  in  Section  5.3. 

The  generalized  expected  value  of  the  variance  of  ability  has  a  recursive  form.  This  recursive  form  is 
based  on  the  same  statistical  rationale  of  item  choice  discussed  in  connection  with  (5.2.1).  Identities  of  this  form 
are  used  in  choosing  the  nth  item  in  the  tailored  sequence  where  n  =  \,  2  ...  qt.  This  generalized  recursive 
form  is  given  by 

%ut  cr2(Q*  I  v*_ , ,  u*)  =  Pr(«*  =  I  |  v*  ,)  cr2(0*  |  v*_  ,,«*  =  1) 

+  Pr (h*  =  0  |  v*_|)  a2(0*  |  v*_, ,u*  =  0).  (5.2.4) 

The  form  (5.2.4)  resembles  (5.2. 1)  except  that  all  terms  are  modified  by  the  conditional  and  generalized  outcome 
vector  v*_,.  The  conditional  and  generalized  outcome  vector,  v*_  ,,  contains  the  binary  scores  for  the  answers 
to  the  (n  -  1)  previously  chosen  items,  along  with  their  original  subscripts  within  the  ability  bank.  In  this  context, 
the  entry  v*_,,  for  n  equal  to  one  represents  the  condition  at  the  beginning  of  testing.  Thus,  v§  is  a  null  entry, 
implied  but  often  unwritten.  The  recursive  form  of  the  generalized  expected  value  takes  into  account  all  the 
information  previously  obtained  through  the  tailored  testing  of  this  particular  individual  where  the  chosen  items 
accessed  optimum  information  in  terms  of  the  reduction  of  the  squared  error  or  the  minimization  of  the  statistical 
expectation  of  the  error  variance  in  ability  estimation. 

Identities  of  (5.2.4)  that  are  both  submodel  specific  and  computationally  convenient  will  be  provided  in 
the  next  section.  The  purposes  in  introducing  (5.2.4)  at  this  juncture  is  to  complete  the  discussion  of  the  statistical 
rationale  basic  to  the  choice  of  items  in  the  tailored  testing  context. 
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5.3  Developments  from  Selection  Theory 

Selection  theory  was  introduced  in  a  landmark  publication  by  Lawley  (1943).  This  theory  later  guided 
important  developments  by  Gulliksen  (1950)  in  the  treatment  of  the  effects  of  variable  selection  on  reliability 
and  validity.  Here,  this  theory  provides  the  basis  for  developments  leading  to  tailoring  algorithms  for  both  the 
two-  and  three-parameter  normal  ogive  submodels. 

For  a  very  readable  and  comprehensive  discussion  of  selection  theory,  the  interested  reader  should  consult 
Lord  and  Novick  (1968).  Their  discussion  provides  an  excellent  background  for  an  understanding  of  the  devel¬ 
opments  leading  to  the  tailored  testing  algorithms. 

In  selection  theory,  several  important  points  emerge.  Two  of  these  points  are  particularly  important  from 
the  standpoint  of  tailored  testing.  First,  any  specifiable  method  of  explicit  selection  is  permissible.  This  point 
has  implications  with  respect  to  terminology.  In  earlier  discussion,  explicit  selection  and  explicit  rejection  were 
considered  as  analogues  of  the  realizations  of  the  Ug  and  the  t/'.  However,  since  any  specifiable  method  of 
explicit  rejection  might  then  also  be  used  as  a  method  of  explicit  selection,  the  distinction  between  explicit 
selection  and  explicit  rejection  becomes  unnecessary  in  derivational  contexts.  In  general  discussion,  this  distinction 
will  still  be  used  to  promote  understanding.  When  the  general  meaning  is  intended  mainly  in  derivational  contexts, 
the  terminology  explicit  selection  will  appear  in  italicized  form.  Also  to  appear  in  italicized  form  will  be  the 
terminology  incidental  selection ,  which  similarly  subsumes  in  meaning  incidental  selection  and  incidental  rejection 
because  the  change  in  perspective  is  permissible  given  the  theory.  That  any  method  of  explicit  selection  is 
permissible  is  advantageous.  This  permissibility  allows  the  use  of  the  notation  U*  for  the  generalized  binary 
random  variable  that  provides  the  analogues  of  explicit  selection .  Submodel  specificity  and  binary  score  contin¬ 
gency  can  be  introduced  after  key  derivations  have  been  obtained.  Second,  successive  explicit  selections  can  be 
summarized  in  a  single  matrix  operation.  This  particularly  important  point  allows  developments  leading  to 
termination  rules  for  the  tailored  testing  process.  These  developments  are  presented  in  Chapter  7  and  involve 
derivations  which  indicate  the  effect  of  termination  on  the  reliability  of  the  results  of  the  tailored  testing  process. 

The  requirements  of  selection  theory  may  be  succinctly  summarized  in  two  basic  assumptions.  The  first 
assumption  is  that  the  regression  of  variables  effected  by  incidental  selection  on  variables  of  explicit  selection 
is  linear;  and  the  second  assumption  is  that  the  partial  variance-covariance  matrix  for  the  variables  effected  by 
incidental  selection ,  given  the  variables  of  explicit  selection ,  is  homoscedastic. 

Generalized  expressions  for  the  choice  of  items,  the  estimation  of  ability,  and  the  estimation  of  the 
variance  of  ability  will  now  be  derived  from  selection  theory  for  the  first  two  items  in  a  tailored  test.  These 
expressions  will  then  be  rendered  submodel  specific  as  well  as  contingent  upon  the  binary  scores.  In  the  following 
chapter  these  expressions  will  be  summarized.  Recursive  forms  will  then  be  induced  that  are  appropriate  for  any 
item  with  subscript  n. 

The  Three-Variable  Selection  Problem 

The  three-variable  selection  problem  provides  the  setting  in  which  answers  are  obtained  to  the  following 
questions: 

1 .  Which  item  should  be  given  first? 

2.  What  is  the  estimate  of  ability  given  the  binary  score  on  this  first  item? 

3.  What  is  the  variance  of  ability  given  the  binary  score  on  this  first  item? 

4.  Can  this  process  of  choosing  and  of  estimating  ability  and  its  variance  be  extended  to  a  second  item? 

In  answering  these  questions  generalized  expressions  are  derived  from  the  assumptions  underlying  the 

three-variable  selection  problem.  These  expressions  are  then  rendered  in  specific  form  by  submodel  and  binary 
score.  In  the  three-variable  selection  problem,  explicit  selection  on  a  predictor  variable  Z2  is  to  occur  after  explicit 
selection  on  a  predictor  variable  Z, .  Incidental  selection  on  the  predictor  variable  Z2  and  the  criterion  variable 
0*  was  imposed  through  explicit  selection  on  the  predictor  variable  Z, .  There  will  be  further  incidental  selection 
with  respect  to  the  criterion  variable  0*  through  subsequent  explicit  selection  on  the  predictor  variable  Z2. 

Assumptions.  Three  subsidiary  assumptions  are  involved:  (a)  the  regressions  of  the  predictor  variable  Z2 
and  the  criterion  variable  0*  on  the  predictor  variable  Z,  remain  unchanged  by  explicit  selection  on  predictor 
variable  Z, ;  (b)  the  partial  variances  of  the  predictor  variable  Z2  and  the  criterion  variable  0*  remain  unchanged 
by  explicit  selection  on  the  partialled  predictor  variable  Z, ;  and  (c)  the  partial  correlation  between  the  predictor 
variable  Z2  and  the  criterion  variable  0*  is  unaltered  by  explicit  selection  on  the  partialled  predictor  variable 
Z, .  These  subsidiary  assumptions  are  consequences  of  the  two  basic  assumptions  presented  earlier. 
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Assumption  (a)  is  algebraically  expressed  in 


(5.3.1) 


and 


(5.3.2) 


where  the  regression  coefficients  on  either  side  of  the  equal  sign  in  both  equations  are  presented  as  a  product 
of  a  correlation  coefficient  and  a  ratio  of  standard  deviations.  The  conditional  expression  vf  is  the  generalized 
outcome  vector,  now  with  one  entry  indicating  whether  Item  1  was  in  free-response  or  multiple-choice  form, 
what  the  binary  score  was,  and  which  item  g,  g(l),  from  the  ability  bank  was  selected  as  Item  1.  This  binary 
score  and  item  identification  allow  complete  definition  of  the  specific  method  of  explicit  selection  that  occurred 
on  Z,.  Accordingly,  p(Zt,Z2  |  vf)  and  p(Z,,0  |  vf)  are  the  respective  correlations  between  Z,  and  Z2  and 
between  Z,  and  0*  after  explicit  selection  on  Z,  as  denoted  by  vf .  Similarly,  the  cr(Z,  |  vf),  cr(Z2  |  vf),  and 
a(9*  |  vf)  are  the  standard  deviations  of  the  indicated  variables  after  explicit  selection  on  Z, .  The  other  terms 
are  as  defined  earlier. 

Assumption  (b)  is  algebraically  expressed  in 


<r2(Z2  |  vf)  [1  -  p2(Z,,Z2  |  vf)]  =  ct2(Z2)  [1  -  p2(Z,,Z2)] 


(5.3.3) 


and 


O-2(0*  I  vf)  [1  -  p2(Z,,0|  Vf)]  =  Or2(9*)  [1  -  P2(Z„0)]. 


(5.3.4) 


The  expressions  on  either  side  of  the  equal  signs  in  both  (5.3.3)  and  (5.3.4)  are  partial  variances.  In  (5.3.3), 
the  partial  variances  are  those  for  Z2  after  and  before  explicit  selection  on  Z, ,  where  Z,  is  the  partialled  variable. 
In  (5.3.4)  the  partial  variances  are  those  for  0*  after  and  before  explicit  selection  on  Z, ,  where  Z,  is  the  partialled 
variable. 

Assumption  (c)  is  algebraically  expressed  in 


VI  -  p2(Z,,Z2  I  vf)  VI  -  p2(Z,  ,0  |  vf)  \  1  -  p2(Z,,Z2)  Vi  -  p2(Z,  ,0) 


where  the  expressions  on  either  side  of  the  equal  sign  are  the  partial  correlations  between  Z2  and  0*  where  Z, 
is  the  partialled  variable.  Reading  from  left  to  right  in  (5.3.5),  one  has  that  the  partial  correlation  after  equals 
the  partial  correlation  before  explicit  selection  on  Z, ,  where  the  specific  method  of  explicit  selection  is  indicated 
by  vf. 

The  relationships  entailed  in  (5.3.2)  and  (5.3.4)  can  be  examined  in  Figure  2.3.1  and  Figure  3.3.1  for 
the  specific  case  where  0*  equals  0,  or  where  0*  is  in  standard  score  form.  It  was  noted  earlier  that  the  means 
and  variances  of  the  conditional  distributions  of  0  given  were  undisturbed  given  either  outcome  or  realization 
of  U g  or  U'H.  The  particulars  of  the  outcome  are  now  recorded  in  vf .  Because  the  means  that  define  the  regressions 
of  0  on  are  undisturbed  and  the  undisturbed  variances  of  0  given  are  identically  the  partial  variances  where 
Zg is  the  partialled  variable,  these  assumptions  have  been  anticipated  by  prior  assumptions.  The  prior  assumptions 
are  those  of  a  normal  distribution  of  ability  and  the  normal  ogive  regression  of  Ug  or  0'  on  ability,  which  in 
turn  define  the  joint  distributions  of  the  Zs  and  0  as  bivariate  normal.  As  seen  in  Figure  2.3. 1  and  Figure  3.3.1, 
the  relationships  given  in  (5.3.2)  and  (5.3.4)  are  merely  the  consequences  of  explicit  selection  given  bivariate 
normality. 

In  regard  to  Figure  2.3.1  and  Figure  3.3.1,  imagine  a  rescaling  of  0  that  results  in  a  given  0*.  This 
rescaling  would  merely  change  the  slope  of  the  regressions  and  alter  the  magnitude  of  the  partial  variances  where 
the  Z,  are  the  partialled  variables.  Subsequently,  explicit  selection  on  the  Z^  would  still  leave  the  regressions 
and  the  partial  variances  undisturbed  as  indicated  in  (5.3.2)  and  (5.3.4) 

Which  Item  First?  At  this  point,  each  item  g  in  the  ability  bank  is  potentially  the  first  item  in  the  tailored 
test.  Which  Z„  becomes  Z,  is  then  the  question.  Thus  the  possible  entries  in  vf  must  be  probabalistically  anticipated 
in  order  to  obtain  the  most  informative  entry.  To  do  this,  one  rewrites  (5.3.4)  as 


*2(9*  |  0*)  [1  -  p2(Z,,0  |  0*)]  =  a2(0*)  [1  -  p2(Zg,0)], 


(5.3.6) 
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which  may  be  rearranged  and  transposed  as 

^(0*  |  £/*)  =  cr^( 0*)  [1  -  p\Zgm  +  0*2(0*  |  £/*)  p2(Zgl6  |  £/£). 

Also,  since  any  Zg  is  potentially  Z}  and  vf  must  be  anticipated,  one  rewrites  (5.3.2)  as 


p(Zg,0\U*) 


aj 0*  |  U*)  ^  cr(0*) 


cr(Zg  |  U*) 


=  p(Z  0) 


o-(ZJ  ’ 


(5.3.7) 


(5.3.8) 


where  it  is  to  be  noted  from  prior  discussion  that  the  standard  deviations  of  the  Zg,  the  a{Zg),  are  all  unity. 
After  this  substitution  for  a(Zg),  and  the  squaring  of  both  sides  of  (5.3.8)..  it  is  known  that 


P2(zg,e\u*) 


cr2(0*  |  U*)  _  2 


cr2(Z,  |  U*) 


where  an  explicit  solution  for  p2(Zg,0  |  t/|)  yields 


P2(Z„,0)  o^©*), 


^(Z.  |  U*)  cr2)©*) 


p2(Zg,o  |  u*)  =  p\zK,0)  ^ !  ut) 


(5.3.9) 


(5.3.10) 


which  may  be  substituted  into  (5.3.7).  After  this  substitution,  one  has,  through  rearranging  terms, 

<r2(0*  |  U*)  =  a2(0*)  {1  -  p2(Zg,0)  [1  -  cr^iZg  \  £/*)]}  (5.3.11) 


as  the  variance  of  ability  for  the  realizations  of  U*  which  can  be  rendered  both  submodel  and  outcome  specific. 

For  the  two-parameter  normal  ogive  submodel,  or  the  case  where  U*  =  Ug,  where  a  correct  answer  to 
item  g,  (ug  =  1),  is  the  anticipated  outcome,  a  substitution  from  (2.2.7)  into  (5.3.11),  along  with  some 
rearrangement,  yields 


cr2(0*  |  ug  =  1)  =  0^(0*) 


P2(Z„0) 


4>(yg) 


<£(%.) 
_  P* 


(5.3.12) 


as  the  variance  of  ability  given  the  correct  answer.  Under  the  same  submodel  and  in  anticipation  of  an  incorrect 
answer  to  item  g,  ( ug  =  0),  a  substitution  from  (2.2.8)  into  (5.3.1 1),  along  with  some  rearrangement,  provides 

cr2(0*  |  ug  =  0)  =  cr2(0*)  jl  -  p2{Zg,0) 


Qg 


+  y* 


(5.3.13) 


as  the  variance  of  ability  given  the  incorrect  answer. 

For  the  two-parameter  normal  ogive  submodel,  where  U*  =  Ug,  substitutions  from  (5.3.12)  and  (5.3.13) 
into  (5.2.2)  move  one  closer  to  an  answer  to  the  query:  Which  item  first?  After  these  substitutions,  it  is  known 
that 


cr2(0*  |  U  )  =  Pg  <x2(0*)  \  1  -  p2{Zg,0) 


<t>(  y.) 


<£(%,)  


p* 


y* 


+  Qh  <t2{0*)  1  -  p\zg,0) 


<H  %>) 

Q* 


4>(yg) 

— 

Qg 


(5.3.14) 


which  can  be  simplified.  Multiplying  through  both  expressions  in  braces  on  the  right  side  of  (5.3.14)  by  their 
respective  probabilities,  Pg  and  Qg,  and  by  rearranging  and  combining  these  expressions,  one  obtains 


%Uc  cr2(0*  |  U.)  = 


a2(0*)  P 


p2(Zg,0)  +  p2(Zg,0)  d>( yg)  yg  +  Qg  ~  P2(Zs,0)  - p2(Zg,0)  <j>( yg)  yg  !>, 


Qg 


(5.3.15) 


where  Pg  and  Qg  are  complementary  terms  adding  to  1 ,  and  the  third  and  sixth  expressions  within  the  braces 
cancel  each  other.  Thus,  one  may  write 


%u,  cr2(0*  |  Ug)  =  cr2(  0*) 


p2(Zg,0)  [<f>(yg)\2 


(5.3.16) 
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where  the  two  fractions  can  be  provided  a  common  denominator.  It  is  then  known  that 


%Ug  0 *  |  Ug)  =  a2(0*) 


P2(Zg,0)  [</>(7,)]2 


e, 

p*Q* 


+ 


(5.3.17) 


But  Pg  and  Qg  are  complementary  terms  adding  to  1 ,  which  leads  to  the  computationally  convenient  solution 


%Uk  a2(0*  |  UK)  =  a2(0*) 


p\Zg,6) 


[Ml 

p*Qg  V 


(5.3.18) 


The  item  g  for  which  (5.3.18)  is  a  minimum  is,  then,  the  most  informative  first  item  given  the  two-parameter 
normal  ogive  submodel.  Note  that  the  variance  of  ability,  a2{0*),  is  a  constant  in  the  evaluation  of  all  items 
with  subscript  g.  Thus  the  maximum  over  g  of  the  second  term  within  the  braces  in  (5.3.18), 


max  p\Zg,G) 

a 


My,)]2 

P*Q* 


(5.3.19) 


will  yield  an  identical  g  to  that  provided  by  the  full  evaluation  of  (5.3.18)  for  all  g;  and,  obviously,  the  minimum 
over  g  of  the  reciprocal  of  the  second  term  within  the  braces  in  (5.3. 18), 


min 

ff 


_ pgQg _ 

P2(Zg,0)  [<f>(yg)]2  ’ 


(5.3.20) 


will  yield  the  same  g  as  would  the  full  evaluation  of  (5.3.18)  for  all  g.  Either  (5.3.19)  or  (5.3.20)  may  then  be 
used  to  choose  the  most  informative  first  item.  While  the  quantities  provided  by  (5.3.18)  yield  more  information 
on  the  items,  either  (5.3.19)  or  (5.3.20)  will  provide  an  identical  choice  of  item.  The  use  of  either  will  introduce 
a  computational  savings. 

For  the  three-parameter  normal  ogive  submodel,  or  the  case  where  U *  =  Ug,  when  a  correct  answer  to 
item  g,  (u^  =  1),  is  the  anticipated  outcome,  a  substitution  from  (3.2.5)  into  (5.3.11),  along  with  some 
rearrangement,  provides 


cr2(6*  |  u'g  =  1)  =  o^©*) 


p2(Z  0) 


(1  -  Cg)  <j>(ys) 


n 


(i  -  Cg)  <A(%) 


p' 

g 


(5.3.21) 


as  the  variance  of  ability  given  the  correct  answer.  For  the  same  submodel  and  in  anticipation  of  an  incorrect 
answer  to  item  g,  {u'g  =  0),  a  substitution  from  (3.2.6)  into  (5.3.11),  along  with  some  rearrangement,  yields 


a2(0*  |  u'g  =  0)  =  a2(0*) 


P2(Zg,6) 


Qg 


(5.3.22) 


as  the  variance  of  ability  given  the  incorrect  answer. 

For  the  three-parameter  normal  ogive  submodel,  where  U*  =  U'g,  substitutions  from  (5.3.21)  and  (5.3.22) 
into  (5.2.3)  move  one  closer  to  an  answer  to  the  query:  Which  item  first?  After  these  substitutions,  it  is  known 
that 


U  **( O *  |  U'g)  =  P'g  a2(0*)  1  -  p2(Zg,Q) 


(1  -  Cg)  <t>(y  ) 


+  q:  °-2(o*)  i  -  p2(zx,0) 


P'g 

Qg 


(l  -  Cg)  <K  y,) 


P'g 


ILL  


+  r, 


g  L  ^g 


(5.3.23) 


which  can  be  simplified.  Multiplying  through  both  expressions  in  braces  on  the  right  side  of  (5.3.23)  by  their 
respective  probabilities,  P'g  and  Q'g,  and  rearranging  and  combining  these  expressions,  one  obtains 


^2(6>*  I  U'g) 


[<M%)]2 


=  c 72(0 *)  jp;  -  p2(Zg,Q)  (1  -  c,)2  —Zf.  +  p\Zg,Q)  (1  -  Cg)  <t>( yg)  yg 

[<f>(yg))2  _y/r7  ^  4>(yx) 


+  Qg  -  Qg  p2(Zg,0) 


Q 


T--QgP2(Zg,0)^yg 


Qg 


(5.3.24) 
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But  Pg  and  Qg  are  complementary  terms  that  add  to  1,  and  substitutions  from  (3.2.2)  into  the  fifth  and  sixth 
terms  within  the  braces  in  (5.3.24)  allow  further  changes  toward  simplification.  After  this  addition  and  these 
substitutions,  one  may  write 


%ui  <r\0*  |  U’)  f 

=  0-2(6*)  1 1  -  p2(Zg,0)  (1  -  cg)2  — jjp-  +  p2(Zg,6 )  (1  -  cg)  4>(yg)  yg 
-  p2(Zg,0)  (1  -  cg)  -(^)|2-  -  p2(Zg,0)  (1  -  cg)  4>(yg)  yJ,  (5.3.25) 

Ug  J 

where  the  third  and  fifth  terms  within  the  braces  in  (5.3.25)  now  cancel  each  other.  The  fourth  term  within  the 
braces  in  (5.3.25)  may  now  be  multiplied  in  both  the  numerator  and  denominator  by  (1  —  cg).  Thereafter,  a 
substitution  from  (3.2.2)  into  the  fourth  term  yields 


%ui  °-2(0*  I  U’)  =  a2(0*)  I  -  p2(Zg,0)  (1  -  c„) 


[</>(%)]2 


n 


-  P2(Zg,0)(l  -  cg)2[-^ 


where  the  second  and  third  terms  can  now  be  combined,  providing 

¥>UI  (r2(0*  |  u1)  =  a2(0*)  I  -  p2(Z  0)  (1  -  cg)2  [ (f>(yg )]2 


I  J_ 
p'  +  O' 

The  two  fractions  in  (5.3.27)  can  now  be  provided  a  common  denominator.  One  then  has 


%ui  v2(6*  I  U')  =  <r2(0*)  1  -  P2(Z,,.0)  (1  -  c„)2  Wyg)]2 


P’ O'  P'  O' 


P' 

1  K 


(5.3.26) 


(5.3.27) 


(5.3.28) 


But  P*  and  Qg  are  complementary  terms  that  add  to  1 .  Thus  it  is  known  that 


%UI  I  U'm)  =  <r2(®*)  \  1  -  P2(Zg,0)  (1  -  Cg)2 


P'Or 


(5.3.29) 


which  may  be  written  as 


H  cr2(0*  |  U'g)  =  a2(0*)  -|  1  -  p\Zg,0)  (1  -  cg) 


(5.3.30) 


because  of  (3.2.2).  In  (5.3.30),  one  now  has  a  computationally  convenient  solution  for  the  evaluation  of  each 
item  g.  That  item  g  for  which  (5.3.30)  is  a  minimum  is,  then,  the  most  informative  first  item  given  the  three- 
parameter  normal  ogive  submodel.  Again  note  that  the  variance  of  ability,  0^(0*),  is  a  constant  in  the  evaluation 
of  all  items  with  subscript  g.  Thus  the  maximum  over  g  of  the  second  term  within  the  braces  in  (5.3.30) 

max  p2{Zg,0)  (1  -  cg)  (5.3.31) 


will  yield  an  identical  g  to  that  provided  by  the  full  evaluation  of  (5.3.30)  for  all  g;  and,  obviously,  the  minimum 
over  g  of  the  reciprocal  of  the  second  term  within  the  braces  in  (5.3.30), 


min 

R 


_ PgQg _ 

P2(Zg,6)  (i  -  Cg)  [(My*)]2  ’ 


(5.3.32) 


will  yield  the  same  g  as  would  the  full  evaluation  of  (5.3.30)  for  all  g.  Either  (5.3.31)  or  (5.3.32)  may  then  be 
used  to  choose  the  first  item.  While  the  quantities  provided  by  (5.3.30)  are  more  informative  with  respect  to 
each  item,  either  (5.3.31)  or  (5.3.32)  may  be  used  to  choose  the  identical  item.  The  use  of  either  will  provide 
a  computational  savings. 

At  this  juncture,  it  may  be  assumed  that  the  first  item  has  been  chosen.  In  the  case  of  the  two-parameter 
normal  ogive  submodel,  one  may  have  used  either  (5.3.18),  (5.3.19),  or  (5.3.20)  for  this  purpose.  In  the  case 
of  the  three-parameter  normal  ogive  submodel,  one  may  have  used  either  (5.3.30),  (5.3.31),  or  (5.3.32)  for  this 
purpose.  This  item  is  subscripted  by  n  within  the  tailored  test.  Because  this  is  the  first  item  in  the  tailored  test, 
its  subscript  takes  on  the  value  1 . 
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What  Is  the  Estimate  of  Ability  Given  the  Binary  Score  on  this  First  Item?  From  (2.2.23),  (2.2.29), 

(3.2.15) ,  and  (3.2.16),  one  knows  that  the  generalized  expression  for  the  estimator  of  ability  is 

fi(0*  |  (Jf)  =  /x(0*)  +  p(Zx,6)  <r(Q*)  tx(Z]  |  Uf),  (5.3.33) 

where  p,(Z,  |  Uf)  is  weighted  by  the  regression  coefficient  given  on  the  right  side  of  the  equal  sign  in  (5.3.2). 
Remember  that  the  numerical  value  of  <x(Z,)  in  (5.3.2)  is  known  to  be  1. 

One  can  now  derive  the  estimator  of  ability  for  the  two-parameter  normal  ogive  submodel,  or  the  case 
where  Uf  =  £/,,  when  a  correct  answer  to  Item  1,  (ux  =  1),  is  the  observed  outcome.  A  substitution  from 
(2.2.23)  into  (5.3.33),  while  exchanging  the  alias  n  for  the  chosen  g(1)  provides 

At(0*  |  w,  =  1)  =  /x(0*)  +  P(ZUG)  o-(0*)  p,(Zl  |  ux  =  1),  (5.3.34) 

which  may  be  expressed  as 

!«,  =  !)  =  P«9*)  +  p(Z,,0)  f 7(0*)  (5.3.35) 

B  i 

because  of  (2.2.23).  The  estimator  of  ability  can  also  be  derived  for  the  same  submodel  and  an  incorrect  answer 
to  Item  1,  (m,  =  0).  A  substitution  from  (2.2.29)  into  (5.3.33),  while  exchanging  the  alias  n  for  the  chosen 
g(1),  provides 

/x(0*  |  ux  =  0)  =  /x(0*)  +  p(Z,,0)  a(0*)  /x(Zj  |  ux  =0)  (5.3.36) 

which  may  be  expressed  as 

p(0 *  |  ux  =  0)  =  /u(0*)  -  p(Z,,0)  cr(0*)  (5.3.37) 

Hi 

because  of  (2.2.29).  In  (5.3.35)  or  (5.3.37),  one  has  a  convenient  expression  to  estimate  ability  given  either 
outcome  in  the  encounter  between  the  individual  and  Item  1  under  the  two-parameter  normal  ogive  submodel. 

One  can  now  derive  the  estimator  of  ability  for  the  three-parameter  normal  ogive  submodel,  or  the  case 
where  Uf  =  U{,  when  a  correct  answer  to  Item  1,  (wj  =  1),  is  the  observed  outcome.  A  substitution  from 

(3.2.15)  into  (5.3.33),  while  exchanging  the  alias  n  for  the  chosen  g(1),  yields 

/x(0*  |  u\  =  1)  =  +  p(Z,,0)  cr(0*)  M(Z,  |  u\  =  1),  (5.3.38) 

which  may  be  expressed  as 

M(6>*  I  «;  =  1)  =  M0*)  +  P(Zi,6)  oiO*)  (1  -  C,)  ^  (5.3.39) 

*  1 

because  of  (3.2,15).  The  estimator  of  ability  can  also  be  obtained  for  the  same  submodel  given  an  incorrect 
answer  to  Item  1,  (u\  =  0).  A  substitution  from  (3.2.16)  into  (5.3.33),  while  exchanging  the  alias  n  for  the 
chosen  g(1),  yields 

p,(0*  |  u\  =  0)  =  /x(0*)  +  p(Z, ,0)  cr(0*)  n(Zx  |  u\  =  0),  (5.3.40) 

which  may  be  expressed  as 

M e *  I  u\  =  0)  =  n(G*)  -  p(Z„e )  <j( O*)  (5.3.41) 

Hi 

because  of  (3.2. 16).  in  (5.3.39)  or  (5.3.41),  one  has  a  convenient  expression  to  estimate  ability  for  either  outcome 
in  the  encounter  between  the  individual  and  Item  1  given  the  three-parameter  normal  ogive  submodel. 

Notice  that  /z(0*  |  ux  ~  0)  and  /x(0*  |  u\  -  0),  as  algebraically  defined  in  (5.3.37)  and  (5.3.41), 
respectively,  are  identical.  These  identities  occur  because  fi{Zx  \  ux  =  0)  and  p(Z]  \  u\  =  0),  as  included  in 
(5.3.36)  and  (5.3.40)  respectively,  also  have  identical  algebraic  definitions.  The  mean  of  Zg  for  the  subpopulation 
on  the  interval  from  negative  infinity  to  yH  remains  undisturbed  by  success  due  to  guessing.  Success  due  to 
guessing  is  assumed  to  occur  at  random  over  this  interval  of  Z?. 

What  Is  the  Variance  of  Ability  Given  the  Binary  Score  on  the  First  Item?  In  deciding  which  item  to 
choose  as  the  first  item  in  the  tailored  test,  it  was  necessary  to  obtain  solutions  for  the  variances  of  ability  given 
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the  realization  of  U*.  The  generalized  expression  was  derived  in  (5.3. 1 1)  and  was  given  submodel  and  outcome 
specificity  in  (5.3.12),  (5.3.13),  (5.3.21)  and  (5.3.22).  In  this  context,  it  is  necessary  merely  to  alias  the  chosen 
g(l)  by  n  in  each  of  these  equations  to  obtain  the  appropriate  expressions. 

Thus,  the  generalized  expression  for  the  variance  of  ability  given  the  realizations  of  Uf  is  obtained  from 
(5.3.11)  through  the  aliasing  of  subscripts  as 

ct2(0*|  Uf)  =  a2(6*)  {1  -  p2(Z,,0)  [1  -  o-2(Z,  I  t/f)]}.  (5.3.42) 

For  the  two-parameter  normal  ogive  submodel,  where  Uf  =  Uu  and  a  correct  answer  to  Item  1, 
(wj  =  1),  is  the  observed  outcome,  the  aliasing  of  the  subscripts  in  (5.3.12)  provides 

cr2(0*  I  «,  =  1)  =  a2(0*)  j  1  -  p2(Z,,0)^ 


<Ky  i) 


j\ 


(5.3.43) 


as  a  convenient  expression  for  the  estimation  of  the  variance  of  ability.  For  the  same  submodel  and  an  incorrect 
answer  to  Item  1,  (w,  =  0),  the  aliasing  of  the  subscripts  in  (5.3.13)  yields 

ctHQ*  |  m,  =  0)  =  cr2(0*)  ( 1  -  p2(Z,,0) 

l  Q\  L  Q\ 

as  a  convenient  expression  for  the  estimation  of  the  variance  of  ability. 

For  the  three-parameter  normal  ogive  submodel,  where  Uf  =  U\,  and  a  correct  answer  to  Item  1, 
(«i  =  1),  is  the  observed  outcome,  the  aliasing  of  the  subscripts  in  (5.3.21)  provides 


7i 


(5.3.44) 


a2(0*  |  u\  =  1)  =  cr2(0 *)  1  -  p2(Z,,0)  - 

l  P\ 

as  a  convenient  expression  for  the  estimation  of  the  variance  of  ability.  For  the  same  submodel  and  an  incorrect 
answer  to  Item  1,  (k{  =  0),  the  aliasing  of  the  subscripts  in  (5.3.22)  yields 


(1  -  £i)  <My,) 

P\ 


7i 


(5.3.45) 


cr2(0* 


u\  =  0)  =  cr2(0*) 


1  -  p2(Z,,0) 


0(7i) 

Qi 


0(y  i) 

.  e. 


+  ri 


(5.3.46) 


as  a  convenient  expression  of  the  estimation  of  the  variance  of  ability.  Notice  that  the  expressions  on  the  right 
side  of  equations  (5.3.44)  and  (5.3.46)  are  identical.  This  indicates  that  o-2(Z,  |  Uf)  of  (5.3.42)  is  identical  for 
the  realizations  (w,  =  0)  and  (u\  =  0).  The  reason  for  this  identity  is  that  the  variance  of  Zg  for  the  interval  on 
ZK  from  negative  infinity  to  yf,  remains  undisturbed  by  the  effect  of  guessing  in  the  three-parameter  normal  ogive 
submodel  because  success  due  to  guessing  is  assumed  random  over  this  interval. 

Can  This  Process  of  Choosing  and  of  Estimating  Ability  and  its  Variance  be  Extended  to  a  Second 
Item?  One  begins  tailoring  a  test  for  an  individual  with  p.(0*),  0^(0*),  and,  consequently,  cr(0*),  known. 
These  values  represent  the  initial  estimate  of  the  individual’s  ability,  its  variance  and  its  standard  deviation.  In 
the  case  of  the  two-parameter  normal  ogive  submodel  a*  and  b*  are  known  for  all  g.  Given  a *  and  cr(0*), 
P(Z*,0)  can  be  obtained  for  all  g  through  the  use  of  (2.2.21);  given  a*,  b* ,  p.(0*)  and  0^(0*),  yg  can  be 
obtained  for  all  g  through  the  use  of  (2.2.22);  and  given  yg,  PH  and  Qg  can  be  obtained  for  all  g  through  the 
use  of  (2.2.1)  and  (2.2.3).  Remember  <b(yg)  is  merely  the  density  in  the  standard  normal  distribution  evaluated 
at  yg  as  given  by  (2.2.5).  Thus,  one  can  use  (5.3.18)  or,  consequently,  (5.3.19)  or  (5.3.20),  to  choose  the  first 
item,  because  the  required  inputs  for  these  equations  are  known  or  readily  obtainable.  What  is  known  or  readily 
obtainable  at  this  point  is  also  sufficient  for  the  estimation  of  ability  and  the  variance  of  ability.  Given  the  selected 
item,  g(1),  its  subscript  is  aliased  by  n  where  n  equals  one.  Then  Item  1  is  presented  to  the  individual.  If  this 
individual’s  answer  to  Item  1  is  correct,  (5.3.35)  is  used  to  estimate  this  individual’s  ability,  and  (5.3.43)  is 
used  to  estimate  the  variance  of  this  individual’s  ability  estimate.  If  the  individual’s  answer  to  Item  1  is  incorrect, 
(5.3.37)  is  used  to  estimate  this  individual’s  ability;  and  (5.3.44)  is  used  to  estimate  the  variance  of  this  individual’s 
ability  estimate. 

In  the  case  of  the  three-parameter  normal  ogive  submodel,  one  also  knows  a*,  b*,  and  c*  for  all  g. 
Given  a*  and  cr(0*),  p(Zs,0)  can  be  obtained  for  all  g  through  the  use  of  (2.2.21);  given  a |,  b*,  p,(0*)  and 
a^iO*),  yg  can  be  obtained  for  all  g  through  the  use  of  (2.2.22);  and  given  yg,  P'g  and  Qg  can  be  obtained  for 
all  g  through  the  use  of  (3.2.1)  and  (2.2.3).  The  density  in  the  standard  normal  distribution  evaluated  at  yg, 
(friy,,),  can  be  obtained  by  evaluating  (2.2.5)  for  all  g.  Thus,  one  can  use  (5.3.30)  or,  consequently,  (5.3.31) 
or  (5.3.32)  to  choose  the  first  item  because  the  required  inputs  for  these  equations  are  known  or  readily  obtainable. 


78 


What  is  known  or  readily  obtainable  at  this  point  is  also  sufficient  for  the  estimation  of  ability  and  the  variance 
of  ability.  Given  the  selected  item  g(1),  its  subscript  is  aliased  by  n  where  n  equals  one .  Item  1  is  then  presented 
to  the  individual.  If  this  individual’s  answer  to  Item  1  is  correct,  (5.3.39)  is  used  to  estimate  this  individual’s 
ability;  and  (5.3.45)  is  used  to  estimate  the  variance  of  this  individual’s  ability  estimate.  If  this  individual’s 
answer  to  Item  1  is  incorrect,  (5.3.41)  is  used  to  estimate  this  individual’s  ability;  and  (5.3.46)  is  used  to  estimate 
the  variance  of  this  individual’s  ability  estimate. 

The  generalized  outcome  vector  v*_j  by  designation  records  the  (n  —  1)  realizations  of  U*_x  for 
(rt-1)  =  0,1,  ...  (<7/-l).  At  this  point  vf  contains  one  of  four  possible  entries:  uHg{l)]  =  1,  =  0, 

M[  (1)]  =  1,  or  u[[g{ uj  =  0,  where  the  bracketed  notation  in  the  subscript  denotes  the  ability  bank  subscript  of  the 
first  chosen  item.  One  now  seeks  the  second  item.  The  outputs  of  (5.3.35),  (5.3.37),  (5.3.39)  and  (5.3.41)  may 
be  rendered  in  generalized  form  as  p(0*  |  vf).  At  this  juncture,  p(0*  I  vf )  and  0^(0*  |  vf )  are  known  Also 
known  are  the  parameters  a*  and  b*,  in  the  two-parameter  case,  or  a* ,  b*9  and  c*,  in  the  three-parameter  case, 
for  all  of  the  items  in  the  ability  bank. 

In  the  following  developments  it  will  be  established  that  enough  information  is  known  for  the  choice  of 
item,  ability  estimation,  and  the  estimation  of  the  variance  of  ability  for  a  tailored  test  of  two  items.  These 
developments  follow  from  the  assumptions,  those  underlying  selection  theory  and  the  restricted  updating  pro¬ 
cedure. 

Under  the  restricted  updating  procedure  the  distributions  of  0*(vf),  the  distributions  of  0*  resulting 
from  incidental  selection  due  to  explicit  selection  on  Z},  are  assumed  normal.  This  assumption  provides  a  very 
workable  approximation,  although  it  is  not  readily  apparent  that  this  should  be  the  case.  For  instance,  it  is  known 
that  the  outcome  dependent  distributions,  the  0*(vf),  can  be  strictly  normal  only  when  p(Zx , 0)  is  zero.  As 
p(Zx,Q)  approaches  the  limiting  value  of  unity,  the  distributions  of  0*(v*)  become  identical  in  form  (but  not 
in  scale)  to  those  distributions  arising  from  explicit  selection  on  the  continuous  variable  Zx  as  implied  by  the 
particular  binary  outcome  vf .  For  the  specific  case  where  0*  is  distributed  as  0  and  p(Zj,0)  approaches  unity, 
the  distributions  0*(vf)  and  Z,(vf)  become  identically  distributed. 

The  distributions  of  0*(vf ),  as  can  be  deduced  from  the  earlier  development  of  the  normal  ogive  submodels 
and  the  illustrations  of  the  hypothetical  relationships  underlying  them  in  Figure  2.1.1  for  the  two-parameter  case 
and  in  Figure  3.1.1  for  the  three-parameter  case,  are  nonnormal.  A  serious  question  then  is  “How  closely  can 
p(Zl70)  approach  this  limiting  value  of  unity  and  still  provide  for  the  workability  of  this  approximation?”  Since 
this  assumption  will  be  applied  sequentially  in  the  restricted  updating  procedure,  a  further  serious  question 
becomes  “How  workable  is  the  approximation  provided  by  the  assumption  of  normal  distributions  for  the 
0*(v*)  as  n,  the  number  of  items  in  the  tailored  test,  increases?” 

The  results  obtained  in  answer  to  these  serious  questions  tend  to  be  counter-intuitive.  The  approximation 
appears  particularly  good  given  well-conditioned  ability  banks  where  an  item  is  normally  chosen  with 
b*  (v*_i)  close  in  value  to  p(0*  |  v*_,).  For  instance,  when  the  correlation  p(Z,,0)  is  in  the  lower  .90’s, 
typically  a  maximum  value  for  this  correlation,  the  assumption  still  provides  a  very  workable  approximation. 
Also,  the  assumption  provides  a  very  workable  approximation  in  sequential  application.  Because  of  the  seriousness 
of  these  questions  and  the  nature  of  their  answers,  results  obtained  from  later  developments  will  now  be  introduced 
which  provide  illustrations  of  the  efficacy  of  the  assumption  underlying  the  restricted  updating  procedure. 

Data  from  an  earlier  empirical  investigation  (Urry,  1977)  of  the  three-parameter  normal  ogive  submodel 
are  relevant.  These  data  are  provided  in  Table  5.3.1.  In  this  table  the  specific  case  is  treated  where  0*  is  assumed 
as  normally  distributed  with  a  mean  of  zero  and  variance  of  unity  or  where  0*  is  distributed  as  0.  The  particular 
scaling  of  0*  has  no  effect  on  the  form  of  the  distributions  of  0*(vj).  In  column  (1),  the  sequential  order  of 
items,  n,  is  presented  for  the  tailored  test  given  to  individual  i.  The  original  correlation  between  Zn  and  0*,p(Z„,0), 
is  given  in  column  (2).  The  outcome  dependent  correlation  between  Zn  and  0*(v;,_j), 
p(Z„, 0  |  j),  is  tabulated  in  column  (3).  This  correlation  is  the  one  modified  by  the  restriction  in  range  implied 

by  the  series  of  explicit  selections  on  the  continuous  variables  Zx  through  Z„_  ,.  Notice  that  this  correlation  more 
noticeably  departs  from  the  original  correlation  p(Z„ ,  0) ,  as  given  in  column  (2),  when  the  restriction  in  range 
becomes  more  severe  or  when  n ,  as  given  in  column  (1),  increases.  In  columns  (4),  (5),  and  (6)  the  item 
parameters  an9  bn,  and  cn  are  provided.  As  will  later  be  found,  the  entries  in  column  (3)  are  obtained  from  an , 
as  given  in  column  (4),  and  cr(0*  |  v'n ),  as  given  in  column  (9),  through  the  use  of  (6.1.7)  for  the  specific  case 
where  0*  is  distributed  as  0.  In  column  (7)  the  binary  outcome  un,  either  a  one  or  a  zero  is  provided,  indicating 
whether  this  individual’s  response  to  the  multiple-choice  item  n  was  correct  or  incorrect.  In  columns  (8)  and 
(9),  the  tailored  test  results  are  presented  for  individual  i.  These  results  are  obtained  through  the  use  of  the 
tailored  testing  algorithm  derived  in  Section  6.2.  This  algorithm  requires  the  assumption  that  the  distributions 
of  0*(v;)  or  merely  0(v'),  in  this  situation,  are  normal.  In  column  (8)  the  ability  estimate,  p(0*  |  v„),  is 
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Table  5.3.1 


The  Similarity  of  Tailored  Test  Results  for  Individual  i  Where  the  Tailoring  Algorithm  Requires  or  Does  Not  Require  the 
Assumption  of  Normal  Distributions  for  the  0*(vn) 


Assumption  of  Normal  Distributions  for  the  Q*{v'») 

Required  by  the 

Not  Required  by  the 

Algorithm 

Algorithm 

Item 

Binary 

Ability 

Ep^r  of 

Ability 

Error  of 

Parameters 

Outcome 

Estimate 

Estimate 

Estimate 

Estimate 

n 

P(Z„,6) 

p(Z„,e  |  vi_,) 

an 

bn 

C„ 

Un 

m(0*  1  v'«) 

aiO*  |  Vn) 

|  V") 

o<0*  |  v,',) 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 

(10) 

(11) 

1 

.90 

.90 

2.09 

-.12 

.18 

1 

.47 

.86 

.47 

.86 

2 

.91 

.89 

2.25 

.59 

.17 

1 

.93 

.75 

.90 

.76 

3 

.89 

.83 

1.94 

.78 

.13 

I 

1.27 

.64 

1.23 

.64 

4 

.89 

.79 

1.99 

.71 

.15 

1 

1.44 

.57 

1.39 

.57 

5 

.81 

.62 

1.39 

1.01 

.15 

1 

1.59 

.53 

1.53 

.55 

6 

.87 

.68 

1.75 

1.65 

.24 

1 

1.77 

.50 

1.73 

.56 

7 

.82 

.58 

1.44 

1.37 

.23 

1 

1.88 

.47 

1.86 

.54 

8 

.84 

.59 

1.56 

1.56 

.30 

1 

1.98 

.45 

1.98 

.52 

9 

.90 

.69 

2.11 

2.26 

.30 

0 

1.80 

.39 

1.76 

.41 

10 

.82 

.49 

1.44 

1  41 

.24 

1 

1.87 

.38 

1.84 

.39 

11 

.82 

.48 

1.44 

1.72 

.25 

1 

1.95 

.37 

1.92 

.38 

12 

.82 

.47 

1.45 

1.87 

.26 

0 

1.80 

.34 

1.77 

.35 

13 

.82 

.44 

1.46 

1.32 

.25 

1 

1.85 

.33 

1.82 

.33 

14 

.81 

.42 

1.40 

1.25 

.29 

1 

1.88 

.32 

1.86 

.32 

15 

.80 

.40 

1.35 

1.93 

.28 

1 

1.94 

.32 

1.92 

.32 

provided.  This  ability  estimate  is  dependent  upon  the  binary  outcomes  u„  as  denoted  by  the  outcome  vector  v;. 
Given  the  binary  outcome  on  Item  1,  this  ability  estimate  is  the  mean  of  the  distribution  of  (9*Oi).  For  the 
outcomes  on  items  subsequent  to  Item  1 ,  it  represents  an  approximation  to  the  mean  of  the  distribution  of 
&*(K)  because  of  the  updating  assumption.  In  column  (9)  the  error  of  the  ability  estimate  o{6*  |  v;)  is  given. 
This  error  is  also  dependent  upon  the  binary  outcomes  u'„  as  denoted  by  the  outcome  vector  v,', .  Given  the  binary 
outcome  on  Item  1,  this  error  of  the  ability  estimate  is  the  standard  deviation  of  the  distribution  of  6>*(v',).  For 
the  outcomes  on  items  subsequent  to  Item  1,  it  represents  an  approximation  to  the  standard  deviation  of  0*(v;) 
because  of  the  updating  assumption.  In  columns  (10)  and  (11)  the  tailored  test  results  for  individual  i  obtained 
through  the  use  of  another  algorithm  are  displayed.  This  algorithm  does  not  require  the  assumption  that  the 
distributions  of  6*(v„),  or  merely  0(v'n),  in  this  situation,  are  normal.  Under  this  algorithm,  the  distributions 
of  0*{vn)  are  obtained  using  a  procedure  to  be  described  in  Section  9.3.  The  means,  the  fi(0*  |  v'„),  and  the 
standard  deviations,  the  cr(6*  |  v,’,),  can  then  be  calculated.  In  this  algorithm  the  means  and  standard  deviations 
are  exactly  determined.  Thus  n(Q*  |  v;)  is  a  least  squares  estimator  of  ability  and  cr(0*  |  v„)  is  the  error  of  this 
least  squares  estimator.  The  means  and  standard  deviations  are  obtained  through  numerical  integration.  In  this 
instance,  the  integrals  required  in  the  calculation  of  the  means  and  standard  deviations  were  evaluated  through 
the  use  of  Simpson’s  Rule.  Given  the  required  integrals,  the  means  and  standard  deviations  presented  in  columns 
(10)  and  (11)  were  then  calculated. 

Since  the  tailored  test  results  presented  in  columns  (8)  and  (9)  are  obtained  through  the  algorithm  where 
the  assumption  of  normal  distributions  for  the  0*(v,’,)  is  required,  one  can  assess  the  workability  of  this  ap¬ 
proximation  by  comparing  these  results  with  those  presented  in  columns  (10)  and  (1 1).  These  latter  results  were 
obtained  through  the  algorithm  where  the  assumption  of  normal  distributions  for  the  9*(v'n)  is  not  required. 

In  Table  5.3.1,  specifically  in  columns  (8)  and  (10)  for  Item  1,  it  may  be  noted  that  the  ability  estimates 
are  identical  in  value,  .47,  across  algorithms,  given  the  binary  outcome  on  this  item.  Also,  given  the  binary 
outcome  on  this  item,  it  may  be  noted  that  the  error  of  these  ability  estimates,  as  given  for  Item  1  in  columns 
(9)  and  (11),  are  also  identical  in  value,  .86,  across  algorithms.  Such  is  the  case  because  the  assumption  of 
normality  that  is  basic  to  the  restricted  updating  procedure  has  not  yet  been  invoked.  Under  the  restricted  updating 
procedure,  normality  is  assumed  in  order  to  continue  the  estimation  of  ability  and  its  error  after  the  results  have 
been  obtained  for  the  binary  outcome  on  the  first  item.  For  Item  2,  one  can  then  compare  the  entry  in  column 
(8)  with  that  in  column  (10)  and  the  entry  in  column  (9)  with  that  in  column  (1 1)  in  order  to  judge  the  workability 
of  this  approximation.  For  the  ability  estimates,  the  p.(G*  \  V2),  the  compared  values  are  .93  and  .90;  and  the 
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compared  values  are  .75  and  .76  for  the  respective  errors  of  these  ability  estimates,  the  o<0*  |  v2).  This  similarity 
in  compared  values  occurs  under  the  condition  where  p(Z1?0)  as  indicated  in  column  (2)  was  .90  prior  to  the 
explicit  selection  on  the  continuous  variable  Zx  as  implied  by  the  outcome  vector  v[.  Thus,  it  is  known  that  the 
distribution  of  0*(v[)  is,  strictly  speaking,  nonnormal;  but  the  similarity  of  results  indicates  that  the  assumption 
of  normality  provides  a  very  workable  approximation  even  when  p(ZuO)  closely  approaches  the  limiting  value 
of  unity.  Subsequently,  the  correlations  of  concern  are  the  p(Z„,0  |  v^),  as  given  in  column  (3).  These 
correlations  do  not  approach  this  limiting  value  as  closely  as  those  given  in  column  (2)  because  of  restriction  in 
range.  One  then  expects  less  severe  departure  from  normality  given  the  binary  outcomes  on  subsequent  items 
as  indicated  by  the  decline  in  the  value  of  the  correlations  in  column  (3)  in  relation  to  those  in  column  (2). 

Intra-item  comparisons  can  likewise  be  made  for  the  remaining  items  in  Table  5.3.1.  These  further 
comparisons  confirm  the  workable  nature  of  the  approximation  provided  by  the  assumption  underlying  the 
restricted  updating  procedure.  The  tailored  test  results  reported  for  the  binary  outcome  on  Item  15  are  of  particular 
interest.  At  this  point,  the  updating  assumption  has  been  invoked  (n-  1)  or  fourteen  times.  One  can  judge  the 
workability  of  the  approximation  in  sequential  application  then  by  comparing  the  /x(0*  |  v'15)  and  the 
a(Q*  |  vi5)  across  algorithms.  For  Item  15,  one  will  want  to  compare:  the  entry  in  column  (8),  or  1.94,  with 
that  in  column  (10),  or  1.92;  and  the  entry  in  column  (9),  or  .32,  with  that  in  column  (11),  or  .32;  where  the 
only  discrepancy  is  a  difference  of  .02  between  p(Q*  |  v'15)  as  approximated  by  the  algorithm  to  be  derived  in 
Section  6.2  and  p,(0*  \  v\5)  as  obtained  from  the  algorithm  that  does  not  require  the  assumption  of  normality 
for  the  0*(v„ _!). 

The  workability  of  this  approximation  can  also  be  assessed  in  the  normative  context.  The  comparisons 
made  in  Table  5.3.1  were  within  the  individual  and  across  algorithms.  In  the  normative  context,  simulation 
procedures  to  be  described  in  Chapter  1 1  may  be  used  to  assess  the  workability  of  this  approximation.  In  brief, 
one  determines  a  particular  terminal  error  using  the  procedures  to  be  described  in  Chapter  7.  Tailored  testing  is 
then  simulated  for  a  large  number  of  individuals  until  this  particular  terminal  error  is  reached.  Subsequently, 
one  can  correlate  the  obtained  ability  estimates  with  values  of  true  ability  which  are  known  given  the  simulation 
procedure.  Since  the  terminal  error,  given  the  updating  assumption,  allows  a  forecast  of  the  correlation  between 
ability  estimates  and  the  values  of  true  ability,  a  comparison  of  the  obtained  correlation  and  the  forecasted 
correlation  provides  an  assessment  of  the  workability  of  this  approximation.  If  the  obtained  correlation  is 
sufficiently  close  in  value  to  the  correlation  forecasted  from  the  theory,  it  can  be  concluded  that  the  assumption 
provides  a  workable  approximation  This  conclusion  follows  because  the  forecasting  of  the  correlation  requires 
an  unspecifiable  but  very  large  number  of  invocations  of  the  updating  assumption.  In  normative  assessments  of 
the  efficacy  of  the  normal  assumption  basic  to  the  restricted  updating  procedure,  it  is  also  found  that  this  assumption 
provides  a  very  workable  approximation.  These  findings  necessarily  follow  when  the  individual  assessments  of 
this  assumption  indicate  its  efficacy. 

Since  the  0*(vf)  can  be  considered  normal  for  practical  purposes,  the  Z2(v *),  the  distribution  of  Z2 
resulting  from  incidental  selection  due  to  explicit  selection  on  Zx  can  also  be  considered  normal  as  a  workable 
approximation.  The  reason  for  the  workability  of  this  approximation  is  that  Z2(vf )  is  a  linear  combination  of 
ability  and  a  homoscedastic  random  error  variable,  which  is  normally  distributed.  Remember,  the  random  error 
variables  are  assumed  under  the  basic  model  to  be  independent  from  item  to  item.  Thus  explicit  selection  on  Zx 
has  no  effect  on  the  homoscedastic  random  error  in  Z2.  As  a  result,  the  joint  distribution  of  Z2(vf )  and  0*(vf ) 
is  bivariate  normal  to  a  workable  approximation. 

Because  bivariate  normality  is  a  workable  approximation,  one  should  seek  convenient  expressions  for 
p(Z2,0  |  vf),  the  correlation  between  Z2(vf)  and  0*(vf),  and  y2(vf),  the  Point  of  dichotomization  on  Z2(vf), 
or,  synonomously,  Z2(vf )  after  its  standardization  to  a  mean  of  zero  and  variance  of  unity.  These  expressions 
will  allow  one  to  continue  with  the  repeated  application  of  the  selection  or  rejection  analogy  in  the  tailored  testing 
context.  One  will  then  be  considering  explicit  selection  on  Z2(vf ),  standardized  Z2(vf ),  where  the  “cut  score” 

is  TiO'*)- 

Since  the  derivations  leading  to  convenient  expressions  for  p(Z^0  |  vf)  and  y2(v* )  are  of  considerable 
length  and  detail,  only  the  principal  results  are  presented  here.  These  derivations  may  be  found  in  Sections  5.4. 
In  the  course  of  these  derivations,  solutions  are  also  found  for  the  parameters  a2(vf ),  item  discriminatory  power, 
and  fr2(vf),  item  difficulty.  These  parameters  are  those  for  Item  2  that  are  appropriate  for  0*(vf),  or  the 
continuous  variable  of  ability  given  the  generalized  outcome  vf  in  standardized  form.  These  parameters  provide 
the  property  of  invariance. 

The  presented  expressions  apply  to  any  potential  second  item  in  the  tailored  test.  At  this  juncture,  there 
are  (p—  1)  items  remaining  in  the  ability  bank  as  possible  choices  for  a  second  item. 
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In  deriving  a  convenient  expression  for  p(Z2,0  |  vf),  it  is  necessary  to  obtain  a2(vf),  the  item  parameter 

of  discriminatory  power  that  is  appropriate  for  0*(vf ),  the  standardized  form  of  the  continuous  variable  of  ability 
subsequent  to  the  generalized  outcome  V] .  The  solution  for  this  parameter  is  provided  by 

a2(vf)  =  a*  a(Q*  |  vf),  (5.3.47) 

where  a*  is  the  parameter  of  item  discriminatory  power  appropriate  for  0*,  as  known;  and  a(0*  |  vf)  is  the 
standard  deviation  of  G*  given  the  generalized  outcome  vf ,  as  provided  by  the  square  root  of  either  (5.3.43) 
or  (5.3.44)  in  the  case  of  the  two-parameter  normal  ogive  submodel,  or  of  either  (5.3.45)  or  (5,3.46)  in  the  case 
of  the  three-parameter  normal  ogive  submodel. 

A  convenient  expression  for  the  correlation  between  Z2  and  G*  given  the  generalized  outcome  vf, 
p(Z2,G  |  vf),  is  provided  by 


P(Z2,0  |  vf) 


_ a*cr(6*  |  vf) 

{ 1  +  [a2(vf)]2}'5  ~  { 1  +  [at*(6*  |  vf)]2} 5  ’ 


(5.3.48) 


where  a2{v , )  is  the  parameter  of  item  discriminatory  power  appropriate  for  0*(vf ),  as  provided  by  (5.3.47); 
a*  is  the  parameter  of  item  discriminatory  power  appropriate  for  0*,  as  known;  and  <r(0*  |  vf)  is  the  standard 
deviation  of  9*  given  the  generalized  outcome  vf ,  as  provided  by  the  square  root  of  either  (5.3.43)  or  (5.3.44) 
in  the  case  of  the  two-parameter  normal  ogive  submodel,  or  of  either  (5.3.45)  or  (5.3.46)  in  the  case  of  the 
three-parameter  normal  ogive  submodel. 

In  deriving  a  convenient  expression  for  y2(vf),  it  is  necessary  to  obtain  a  solution  for  b2{v* ),  the  parameter 

of  item  difficulty  appropriate  for  0*(vf),  the  continuous  variable  of  ability  given  the  generalized  outcome  vf 
in  standardized  form.  The  solution  for  this  parameter  is  provided  by 


b2(vf) 


b^-pjG*  |  vf) 

cr(0*  |  vf) 


(5.3.49) 


where  b*  is  the  parameter  of  item  difficulty  appropriate  for  Q* ,  as  known;  p(G*  |  vf)  is  the  estimator  of  ability 
as  provided  by  either  (5.3.35)  or  (5.3.37)  in  the  case  of  the  two-parameter  normal  ogive  submodel  or  by  either 
(5.3.39)  or  (5.3.41)  in  the  case  of  the  three-parameter  normal  ogive  submodel;  and  a(G *  |  vf)  is  the  standard 
deviation  of  G*  given  the  generalized  outcome  vf ,  as  provided  by  the  square  root  of  either  (5.3.43)  or  (5.3.44) 
in  the  case  of  the  two-parameter  normal  ogive  submodel,  or  of  either  (5.3.45)  or  (5.3.46)  in  the  case  of  the 
three-parameter  normal  ogive  submodel. 

A  convenient  expression  for  the  point  of  dichotomization  on  Z2(vf),  the  standardized  form  of  the  con¬ 
tinuous  variable  Z2  given  the  generalized  outcome  vf,  is  provided  by 


y2(vf) 


fr2  1  vf) 

[(of)-2  +  cr2(0*  |  vf)]-5  ’ 


(5.3.50) 


where  of  and  b*  are  the  parameters  of  item  discriminatory  power  and  item  difficulty,  respectively,  that  are 
appropriate  for  G *,  as  known;  p.(G*  |  vf)  is  the  estimator  of  ability,  as  provided  by  either  (5.3.35)  or  (5.3.37) 
in  the  case  of  the  two-parameter  normal  ogive  submodel  or  by  either  (5.3.39)  or  (5.3.41)  in  the  case  of  the 
three-parameter  normal  ogive  submodel;  and  a2(G*  |  vf)  is  the  variance  of  0*  given  the  generalized  outcome 
vf,  as  provided  by  either  (5.3.43)  or  (5.3.44)  in  the  case  of  the  two-parameter  normal  ogive  submodel  or  by 
either  (5.3.45)  or  (5.3.46)  in  the  case  of  the  three-parameter  normal  ogive  submodel. 

As  indicated  by  the  asterisk  on  the  generalized  outcome  vf ,  the  item  parameters  defined  in  (5.3.47)  and 
(5.3.49)  are  those  for  both  the  two-  and  three-parameter  normal  ogive  submodels.  These  respective  parameters 
are  defined  in  an  identical  manner  under  both  submodels.  In  the  three-parameter  normal  ogive  submodel,  the 
third  item  parameter  appropriate  for  0*(vf ),  the  standardized  form  of  the  variable  of  ability  given  the  outcome 
v  j ,  is  provided  by 


c2(y'i)  =  cf  =  c2,  (5.3.51) 

which  indicates  that  the  lower  asymptote  of  the  characteristic  curve  for  Item  2  remains  undisturbed  by  a  linear 
transformation  of  the  continuous  variable  of  ability. 
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For  both  submodels,  the  given  item  parameters  provide  the  property  of  invariance.  The  probability  of  a 
correct  answer  to  Item  2  remains  invariant  for  corresponding  values  of  0,  0*,  and  0*(vf).  Under  these  changes 
in  the  scale  of  the  continuous  variable  of  ability,  the  characteristic  curve  for  Item  2  remains  invariant. 

At  this  point,  it  is  evident  that  the  process  can  be  extended.  This  extension  of  the  process  consists  of 
choosing  the  second  item  and  of  estimating  ability  and  its  variance  given  the  outcome  on  this  chosen  item.  For 
the  extension  of  the  process,  one  now  turns  to  the  setting  of  the  four-variable  selection  problem. 

The  Four-Variable  Selection  Problem 


The  four-variable  selection  problem  provides  the  setting  in  which  the  answers  are  obtained  to  the  following 
questions: 

1 .  Which  item  should  be  given  second? 

2.  What  is  the  estimate  of  ability  given  the  binary  score  on  this  second  item? 

3.  What  is  the  variance  of  ability  given  the  binary  score  on  this  second  item? 

4.  Can  this  process  of  choosing  and  of  estimating  ability  and  its  variance  be  extended  to  a  third  item? 

In  answering  these  questions,  generalized  expressions  are  derived  from  the  assumptions  underlying  the 

four-variable  selection  problem.  These  expressions  are  then  rendered  in  specific  form  by  submodel  and  binary 
score.  In  the  four-variable  selection  problem,  explicit  selection  on  a  predictor  variable  Z3  is  to  occur  after  explicit 
selections  on  the  predictor  variables  Z,  and  Z2.  Incidental  selections  on  the  predictor  variable  Z3  and  the  criterion 
variable  0*  were  imposed  through  explicit  selections  on  the  predictor  variables  Z,  and  Z2.  There  will  be  further 
incidental  selection  with  respect  to  the  criterion  variable  0*  through  subsequent  explicit  selection  on  the  predictor 
variable  Z3. 

Assumptions.  Three  subsidiary  assumptions  are  involved:  (a)  the  regressions  of  the  predictor  variable  Z3 
and  the  criterion  variable  0*  on  the  predictor  variable  Z2  remain  unchanged  by  explicit  selections  on  the  predictor 
variables  Z,  and  Z2;  (b)  the  partial  variances  of  the  predictor  variable  Z3  and  the  criterion  variable  0*,  where 
the  partialled  predictor  variable  is  Z2,  remain  unchanged  by  explicit  selections  on  the  predictor  variables  Zx  and 
Zi,  and  (c)  the  partial  correlation  between  the  predictor  variable  Z3  and  the  criterion  variable  0*  with  Z2  as  the 
partialled  predictor  variable  remains  unaltered  by  explicit  selections  on  the  predictor  variables  Z,  and  Z2.  These 
subsidiary  assumptions  are  consequences  of  the  two  basic  assumptions  presented  earlier. 

Assumption  (a)  is  algebraically  expressed  in 


p(Z2,Z3 


*,  o~(Z3  |  r2 ) 

^2  )  /  '-y  [  \ 

<x(Z2  I  v2 ) 


P(Z2,Z3 


*\ 
v\ ) 


o~(Z3  |  vf) 
cr(Z2  |  vf) 


p(Z2,Z3) 


<7-(Z3) 

cr(Z2) 


(5.3.52) 


and 


P(Z2,0 


*.  o~(0*  |  vf) 

o-(Z2  |  v2 ) 


p(Z2,0 


*  \ 

”i) 


of 0*  I  vf) 

o-(Z2  |  vf) 


p(Z2,0) 


cr(0*j 

o-(Z2) 


(5.3.53) 


where  the  three  equalities  in  both  equations  are  regression  coefficients  presented  as  the  product  of  a  correlation 
coefficient  and  a  ratio  of  standard  deviations.  The  conditional  expression  vf  is  the  generalized  outcome  vector, 
now  with  two  entries:  vf  as  defined  earlier  and  an  entry  indicating  whether  Item  2  was  in  free-response  or 
multiple-choice  form,  what  the  binary  score  was,  and  which  item  g ,  ga\  from  the  ability  bank  was  chosen  as 
Item  2.  This  binary  score  and  item  identification  allow  complete  definition  of  the  specific  method  of  explicit 
selection  that  occurred  on  Z2(vf).  Accordingly,  p(Z2,Z3  |  vf)  and  p(Z2,0  |  vf)  are  the  respective  correlations 
between  Z2  and  Z3  and  between  Z2  and  0*  after  explicit  selections  on  Z,  and  Z2(vf).  Correspondingly, 
cr(Z2  |  vf),  cr(Z3  |  vf),  and  cr(0 *  |  vf)  are  the  standard  deviations  of  the  indicated  variables  after  explicit 
selections  on  Z,,  and  Z2(vf).  The  other  terms  are  as  defined  earlier. 

Assumption  (b)  is  algebraically  expressed  in 

ct2(Z3  |  vf)[l  -p2(Z2,Z3  |  vf)]  =  ct2(Z3  |  vf ) [  1  —  p2(Z2,Z3  |  vf)]  =  o-2(Z3)[l-p2(Z2,Z3)]  (5.3.54) 

and 

cr2(0*  |  vf)[l -p2(Z2,0  |  vf)]  =  cr2(0*  |  vf ) [  1  - p2(Z2, 0  |  vf)]  =  cr2(0*)[l -p2(Z2,0)],  (5.3.55) 

where  the  three  equalities  in  both  equations  are  partial  variances.  In  (5.3.54)  and  reading  from  left  to  right,  the 
partial  variances  are  those  of  Z3:  where  the  partialled  variable  is  Z2;  after  explicit  selections  on  Z,  and  Z2(vf); 
after  explicit  selection  on  Z,  and  before  explicit  selection  on  Z2(vf );  and  before  any  explicit  selection.  In  (5.3.55), 
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reading  from  left  to  right,  the  partial  variances  are  those  of  0*  where  the  partialled  variable  is  Z2:  after  explicit 
selections  on  Z,  and  Z2(vf );  after  explicit  selection  on  Z,  and  before  explicit  selection  on  Z2(vf);  and  before 
any  explicit  selection. 

Assumption  (c)  is  algebraically  expressed  in 

p(Z3,0  |  v* )  ~  P(Z2,Z3  |  vj)  |  v2*)  =  p(Z3,0  |  vf)  -  p(Z2,Z3  |  vf)p(Z2,0  |  vf) 

Vl  -P2(Z2,Z3  |  v2)  Vl  -p2(Z2,0  [  vf)  \  1  -p2(Z2,Z3  |  vf)  VI  -p2(Z2,0  |  vf) 

_  P(Z3 , 0)  -  p(Z2,Z3)p(Z2, 0) 

\  l-p2(Z2,Z3)  V1-p2(Z2,0)  (5.3.56) 

where  the  three  equalities  are  the  partial  correlations  between  Z3  and  0*  where  Z2  is  the  partialled  variable.  In 
(5.3.56)  and  reading  from  left  to  right,  this  partial  correlation  is  represented:  after  explicit  selections  on  Z,  and 
^i(v t  )>  after  explicit  selection  on  Z]  and  before  explicit  selection  on  Z2(vf)j  and  before  any  explicit  selection 

Some  Consequences  of  the  Submodels  and  the  Updating  Assumption.  At  this  juncture  it  is  convenient  to 
summarize  some  intermediate  results.  These  results  are  derived  in  Section  5.4  and  are  required  in  subsequent 
derivations.  These  derivations  will  be  used  to  develop  solutions  for  the  questions  posed  earlier:  Which  item 
should  be  given  second'’  W  hat  is  the  estimate  of  ability  given  the  binary  score  on  this  second  item?  and  What 
is  the  variance  of  ability  given  the  binary  score  on  the  second  item? 

These  intermediate  results  consist  of  expressions  for:  the  probabilities  of  correct  and  incorrect  answers 
to  Item  2  given  the  generalized  outcome  vf ;  the  means  of  Z2(vf)  and  Z2(vf)  for  each  of  the  realizations  of  the 
generalized  binary  random  variable  U*  where  Z2(vf )  is  a  mean  deviate  form  of  the  continuous  variable  Z2(vf ); 
and  the  variances  of  Z2(vf)  given  each  of  the  realizations  of  the  generalized  binary  random  variable  U*  where 
Z2(vf)  is  the  standardized  form  of  the  continuous  variable  Z2  subsequent  to  the  effects  of  incidental  selection 
resulting  from  explicit  selection  on  the  continuous  variable  Z,  as  indicated  by  the  generalized  outcome  vf . 

Given  the  two-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 
G  : 


The  probability  of  a  correct  answer  to  Item  2,  Pr(n2  =  1  |  v,)  or  P2(v,),  is  provided  by 

Pr(«2  =  1  |  v,)  =  P2(v,)  =  Pr[Z2(v,)  2=  y2(v,)]  =  <f[  -  y^v,)],  (5.3.57) 

where  Pr[Z2(v,)  3=  y2(V|)]  is  the  probability  that  £2(v,)  is  greater  than  or  equal  to  y2(v,),  the  point 
of  dichotomization  on  Z2(v,),  the  standardized  form  of  the  continuous  variable  Z2  subsequent  to 
the  effects  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Z, 
as  indicated  by  the  outcome  v,.  The  point  of  dichotomization,  y2(v,),  is  provided  by  (5.3.50) 
after  setting  the  generalized  outcome  vf  equal  to  v,.  In  (5.3.57),  ~<P[  -  y2(vi)]  is  the  cumulative 
normal  distribution  function  evaluated  for  Z^(V|)  on  the  interval  extending  from  negative  infinity 
to  negative  y2(v,)  or,  due  to  symmetry,  the  area  above  y2(v,)  in  the  standard  normal  distribution. 

The  probability  of  an  incorrect  answer  to  Item  2,  Pr(u2  =  0  |  v,)  or  g2(v,),  is  provided 
by 


Pr(n2  =  0  |  v,)  =  Q2(v ,)  =  Pr[Z2(v,)  <  y2(v,)]  =  0[y2(v,)],  (5.3.58) 

where  PrfZ^v,)  <  y2(v,)]  is  the  probability  that  £,(v,)  is  less  than  y2(v,),  the  point  of  dichotom¬ 
ization  on  Z2(v,),  the  standardized  form  of  Z2  subsequent  to  the  effects  of  incidental  selection 
resulting  from  explicit  selection  on  Z,  as  indicated  by  the  outcome  v, .  The  point  of  dichotomization 
is  provided  by  (5.3.50)  after  setting  the  generalized  outcome  vf  equal  to  v,.  In  (5.3.58),  <f[y2(V|)] 
is  the  cumulative  normal  distribution  function  evaluated  for  that  interval  of  Z2(v,)  extending  from 
negative  infinity  to  y2(V|),  or  the  area  below  y2(vi)  in  the  standard  normal  distribution. 

Given  the  three-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous 
outcome  vj: 


The  probability  of  a  correct  answer  to  Item  2,  Pr(«j  =  1  |  vj)  or  P2(vi),  is  provided  by 
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Pr  (u2  =  1  |  vi)  =  P2(v i) 

=  Pr[Z2(vj)  3=  y2(vj)]  +  c2  Pr[Z2(vj)  <  y2(vi)] 

=  c2  +  (1  -  c2)  <£{-y2(v;)],  (5.3.59) 

where  Pr[Z2(vi)  3=  y2(v,)]  is  the  probability  that  l2(v\)  is  equal  to  or  greater  than  y2(v|),  the  point 
of  dichotomization  on  Z2(vj),  the  standardized  form  of  the  continuous  variable  Zj  subsequent  to 
the  effects  of  incidental  selection  resulting  from  explicit  selection  on  Z,  as  indicated  by  the  outcome 
v'u  Viiv'i),  as  defined,  is  provided  by  (5.3.50)  after  setting  the  generalized  outcome  vf  equal  to 
vi;  c2  is  the  coefficient  of  guessing  for  Item  2,  as  known;  Pr[Z2(vi)  <  y2(vj)]  is  the  probability 
that  &(vj)  is  less  than  y2(vj);  and  <i>[-y2(vl)]  is  the  cumulative  normal  distribution  function 
evaluated  for  the  interval  of  Z2(v\)  extending  from  negative  infinity  to  negative  y2(vi)  or,  due  to 
symmetry,  the  area  above  y2(vj)  in  the  standard  normal  distribution. 

The  probability  of  an  incorrect  answer  to  Item  2,  Pr (u2  =  0  |  vj)  or  g2(vj),  is  provided 
by 

Pr U2  =  0  |  vj)  =  Q2(v i) 

=  (1  -  c2)  Pr[Z2(vj)  <  y2(vj)]  =  (1  -  c2)  #ty2(v',)],  (5.3.60) 

where  c2  is  the  coefficient  of  guessing  for  Item  2,  as  known;  Pr[Z2(v',)  <  y2(vi )]  is  the  probability 
that  l2{v\)  is  less  than  y2(vj),  the  point  of  dichotomization  on  Z2(vi),  the  standardized  form  of 
the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental  selection  resulting  from  explicit 
selection  on  Z,  as  indicated  by  the  outcome  v|.  The  point  of  dichotomization  y2(v',)  is  provided 
by  (5.3.50)  after  setting  the  generalized  outcome  vf  equal  to  vj.  In  (5.3.60),  <P[y2(v\)]  is  the 
cumulative  normal  distribution  function  evaluated  for  the  interval  of  Z2(v',)  extending  from  negative 
infinity  to  y2(vj),  or  the  area  below  y2(vj)  in  the  standard  normal  distribution. 

Given  the  two-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 


The  mean  of  Z2(v,),  when  a  correct  answer  to  Item  2  is  observed,  p(Z2  |  v, ,u2  =  1),  is 
provided  by 


p(Z2  |  v,,k2 


<^>['Y2(v  i  )  1 

PifTi) 


(5.3.61) 


where  y2(v,)  is  the  point  of  dichotomization  on  Z2(v,),  the  standardized  form  of  the  continuous 
variable  Z2  subsequent  to  the  effects  of  incidental  selection  resulting  from  explicit  selection  on 
the  continuous  variable  Z,  as  indicated  by  the  binary  outcome  v,;  y2(v,)  is  provided  by  (5.3.50) 
after  setting  the  generalized  outcome  vf  equal  to  v,;  $[y2(v,)]  is  the  density  in  the  standard  normal 
distribution  evaluated  at  y2(v,),  as  obtained  from  (2.2.5)  after  a  substitution  of  y2(v,)  for  ys;  and 
P2(v,)  is  the  probability  of  a  correct  answer  to  Item  2  given  the  outcome  v,,  as  obtained  from 
(5.3.57). 


The  mean  of  Z2(v,)  when  an  incorrect  answer  to  Item  2  is  observed,  p(Z2  \  v,  ,u2  =  0), 
is  provided  by 


p,(Z2  I  v,  ,u2  =  0)  = 


fHyiivQ] 

02(v,) 


(5.3.62) 


where  y2(v,)  is  the  point  of  dichotomization  on  Z2(v,),  the  standardized  form  of  the  continuous 
variable  Z2  subsequent  to  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the 
continuous  variable  Z,,  as  indicated  by  the  outcome  v, ;  y2(v,)  is  obtained  from  (5.3.50)  after 
setting  the  generalized  binary  outcome  vf  equal  to  v,;  <£[y2(v,)]  is  the  density  in  the  standard 
normal  distribution  at  y2(v,)  as  provided  by  (2.2.5)  after  a  substitution  of  y2(v,)  for  y^;  and  Q2(vt) 
is  the  probability  of  an  incorrect  answer  to  Item  2  given  the  binary  outcome  v.,  as  obtained  from 
(5.3.58). 
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Given  the  three-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 


vi: 


The  mean  of  Z2(v |)  when  a  correct  answer  to  Item  2  is  observed,  p(Z2  \  vj  ,u2  =  1),  is 
provided  by 

/x(Z2  |  v\,u2  =  1)  =  (1  -  c2)  (5.3.63) 

^2(V|) 

where  c2  is  the  coefficient  of  guessing  for  Item  2,  as  known;  y2(vj)  is  the  point  of  dichotomization 
on  Z2(vj),  the  standardized  form  of  the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental 
selection  resulting  from  explicit  selection  on  Zj,  as  indicated  by  the  binary  outcome  vj;  y2(vj)  is 
provided  by  (5.3.50)  after  setting  the  generalized  binary  outcome  vf  equal  to  vj;  4>[y2(v\)]  is  the 
density  in  the  standard  normal  distribution  evaluated  at  y2(vj)  as  obtained  from  (2.2.5)  after  a 
substitution  of  y2(vj)  for  yg\  and  P2(v\)  is  the  probability  of  a  correct  answer  to  Item  2  given  the 
binary  outcome  vj  as  provided  by  (5.3.59). 


The  mean  of  Z2(vj)  when  an  incorrect  answer  to  Item  2  is  observed,  p(Z2  \  vj,wj  =  0), 
is  provided  by 


/x(Z2  I  vi,«2  =  0) 


</>[T2(Vl)] 

e2(v',)  ’ 


(5.3.64) 


where  y2(vj)  is  the  point  of  dichotomization  on  Z2(vj),  the  standardized  form  of  the  continuous 
variable  Z2  subsequent  to  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the 
continuous  variable  Z,  as  indicated  by  the  binary  outcome  vj;  y2(vj )  is  obtained  from  (5.3.50) 
after  setting  the  binary  outcome  vf  equal  to  vj;  </>[y2(v j)]  is  the  density  in  the  standard  normal 
distribution  evaluated  at  y2(vj),  as  provided  by  (2.2.5)  after  a  substitution  of  y2(vj)  for  yg\  and 
Q2(v\)  is  the  probability  of  not  recognizing  the  correct  alternative  to  multiple-choice  Item  2  given 
the  binary  outcome  vj.  The  probability  Q2(v j)  is  provided  by 

Qi(v\)  =  Pr[Z2(vj)  <  y2(v,)]  =  <£[y2(vj)],  (5.3.65) 

where  Pr[Z2(vj)  <  y2(vj)]  is  the  probability  that  £2(vj)  is  less  than  y2(vj),  the  point  of  dichotom¬ 
ization  on  the  continuous  variable  Z2(vj),  the  standardized  form  of  Z2  subsequent  to  the  effect  of 
incidental  selection  resulting  from  explicit  selection  on  Z,  as  indicated  by  the  binary  outcome 
vj;  y2(vj)  is  obtained  from  (5.3.50)  after  setting  the  generalized  binary  outcome  vf  equal  to  vj . 
In  (5.3.65),  ^[y2(vj)]  is  the  cumulative  normal  distribution  function  evaluated  for  that  interval 
of  Z2(vj)  extending  from  negative  infinity  to  y2(vj),  or  the  area  below  y2(vj)  in  the  standard 
normal  distribution. 


For  later  developments,  it  is  useful  to  define  the  continuous  variable  Z2(vf )  whose  realizations,  £2(vf  ),are 
provided  by 

&(vf)  =  &  -  MZ2  I  vf).  (5.3.66) 

This  continuous  variable  is  merely  the  continuous  variable  Z2  in  mean  deviate  form  about  /x(Z2  |  vf),  the  mean 
of  the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental  selection  resulting  from  explicit  selection  on 
Zj  as  indicated  by  the  generalized  binary  outcome  vf .  For  this  situation,  it  is  known  that  the  mean  of  the 
continuous  variable  Z2(vf)  given  the  realization  of  the  generalized  binary  random  variable  £/*,  jii(Z2  |  vf  ,£/*), 
is  provided  by 


m(Z2  I  vf  ,£/* )  =  cr(Z2  I  vf)  n .  (Z2  I  v*,U*) 

=  fi(Z2  |  v*,U*)  ~  I  vf),  (5.3.67) 

where  cr(Z2  |  vf)  is  the  standard  deviation  of  the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental 
selection  resulting  from  explicit  selection  on  the  continuous  variable  Z{  as  indicated  by  the  generalized  binary 
outcome  vf;  p{Z2  |  vf  ,U2)  is  the  mean  of  Z2,  the  standardized  form  of  the  continuous  variable  Z2  subsequent 
to  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Zx  as  indicated 
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by  the  generalized  outcome  v*,  which  is  then  subjected  to  explicit  selection  as  indicated  by  the  generalized 
binary  variable  U* ;  p(Z2  |  v* ,U*)  is  the  mean  of  the  continuous  variable  Z2  in  its  original  scale  after  both  the 
effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Z,  as  indicated  by  the 
generalized  outcome  v*  and  the  effect  of  explicit  selection  as  indicated  by  the  generalized  binary  variable  U*\ 
and  ix(Z2  |  v  j )  is  the  mean  of  the  continuous  variable  Z2  after  the  effect  of  incidental  selection  resulting  from 
explicit  selection  on  Z,  as  indicated  by  the  generalized  outcome  vf .  The  generalized  form  (5.3.67)  can  be  rendered 
both  submodel  and  outcome  specific. 

Given  the  two-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 

vi: 

The  mean  of  the  continuous  variable  Z2(v,)  when  a  correct  answer  to  Item  2  is  observed, 

H{Z2  |  Vi,u2  =  1),  is  provided  by 

H(Z2  |  v,,n2  =  1)  =  cr(Z2  |  v,)  <^y2(V')],  (5.3.68) 

P  2(v,) 

where  <x(Z2  |  v,),  a  term  cancelled  in  later  derivation,  is  the  standard  deviation  of  the  continuous 
variable  Z2  after  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous 
variable  Z,  as  indicated  by  the  binary  outcome  v,;  y2(v,)  is  the  point  of  dichotomization  on  the 
continuous  variable  Z2(v,),  the  standardized  form  of  the  continuous  variable  Z2  subsequent  to  the 
effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Z, ,  as 
indicated  by  the  binary  outcome  v, ;  <t>{ y2(v,)]  is  the  density  in  the  standard  normal  distribution 
evaluated  at  y2(v,);  and  P2(v ,)  is  the  probability  of  a  correct  answer  to  Item  2  given  the  binary 
outcome  v(. 

The  mean  of  the  continuous  variable  Z2(v, )  when  an  incorrect  answer  to  Item  2  is  observed, 
yu,(Z2  |  vt,u2  =  0),  is  provided  by 

p(Z2  |  v,,m2  =  0)  =  -  cr(Z2  |  v,)  ^T2(V|)],  (5.3.69) 

where  <x(Z2  |  v,),  a  term  cancelled  in  later  derivation,  is  the  standard  deviation  of  the  continuous 
variable  Z2  after  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  Zx  as  indicated 
by  the  binary  outcome  v];y2(vl)  is  the  point  of  dichotomization  on  Z2{vx),  the  standardized  form 
of  the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental  selection  resulting  from  explicit 
selection  on  the  continuous  variable  Z,  as  indicated  by  the  binary  outcome  Vj;  <My2(v,)]  *s  the 
density  in  the  standard  normal  distribution  evaluated  at  y2(v,);  and  02(v,)  is  the  probability  of  an 
incorrect  answer  to  Item  2  given  the  binary  outcome  v}. 

Given  the  three-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 
v\: 


The  mean  of  the  continuous  variable  Z2(vi)  when  a  correct  answer  to  Item  2  is  observed, 
fx{Z2  |  v[,u2  =  1),  is  provided  by 

p,(Z2  |  v\,u2  =  1)  =  cr(Z2  |  vj)(l  -  c2)  (5.3.70) 

^l) 

where  a(Z2 1  vj),  a  term  cancelled  in  later  derivation,  is  the  standard  deviation  of  the  continuous 
variable  Z2  after  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous 
variable  Z,  as  indicated  by  the  binary  outcome  v; ;  c2  is  the  coefficient  of  guessing  for  Item  2; 
y2(vi)  is  the  point  of  dichotomization  on  Z2(vl),  the  standardized  form  of  the  continuous  variable 
Z2  subsequent  to  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous 
variable  Z,  as  indicated  by  the  binary  outcome  vj;  <J>[y2(v\)]  is  the  density  in  the  standard  normal 
distribution  evaluated  at  y2(v‘, );  and  P'2(v\)  is  the  probability  of  a  correct  answer  to  Item  2  given 
the  binary  outcome  v j. 

The  mean  of  the  continuous  variable  Z2(v  j )  when  an  incorrect  answer  to  Item  2  is  observed, 
P(Z2  \  v[,u2  =  0),  is  provided  by 


p(Z2  |  v\,u2  =  0) 


0[y2(vj 

e2(vi)  ’ 


(5.3.71) 
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where  cr(Z2  |  v\),  a  term  cancelled  in  later  derivation,  is  the  standard  deviation  of  the  continuous 
variable  Z2  after  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous 
variable  Zx  as  indicated  by  the  binary  outcome  v, ;  y2(v\)  is  the  point  of  dichotomization  on 
Z2(v  j),  the  standardized  form  of  the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental 
selection  resulting  from  explicit  selection  on  the  continuous  variable  Zx  as  indicated  by  the  binary 
outcome  vj;  </>[y2(vi)]  density  in  the  standard  normal  distribution  at  y2(vj);  and  02(vi )  is 
the  probability  of  not  recognizing  the  correct  alternative  to  multiple-choice  Item  2  given  the  binary 
outcome  vj. 


The  submodel  and  outcome  specific  forms  (5.3.68)  through  (5.3.71)  will  be  used  in  later  derivations. 
These  later  derivations  will  provide  an  answer  to  the  query,  “What  is  the  estimate  of  ability  given  the  binary 
score  on  the  second  item?” 

Given  the  two-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 

The  variance  of  the  continuous  variable  Z2(v,)  when  a  correct  answer  to  Item  2  is  observed, 
cr2(Z2  |  v1?w2  =  1),  is  provided  by 


(T2(Z2  |  V,,«2  =  1)  = 


ct2(Z2  I  V|  ,k2  =  1) 
a2(Z2  |  v,) 


=  1 


<fr[y2(vi)] 

^(v.) 


^[ysCvi)] 

P2(Vl) 


(5.3.72) 


where  cr1(Z1  \  vuu2  =  1)  is  the  variance  of  the  continuous  variable  Z2  as  originally  scaled  after 
both  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable 
Zx  as  indicated  by  the  outcome  v,  and  the  effect  of  explicit  selection  as  indicated  by  w2,  the 
realization  of  the  binary  variable  U2\  cr2(Z2 1  v, )  is  the  variance  of  the  continuous  variable  Z^  after 
the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Z,  as 
indicated  by  the  outcome  vx ;  y2(V])  is  the  point  of  dichotomization  on  Z2(Vj),  the  standardized 
form  of  the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental  selection  resulting  from 
explicit  selection  on  the  continuous  variable  Zx  as  indicated  by  the  outcome  v,;  4>[y2(vx)]  is  the 
density  in  the  standard  normal  distribution  evaluated  at  y2(v,);  and  P2(V])  is  the  probability  of  a 
correct  answer  to  Item  2  subsequent  to  the  outcome  vx. 


The  variance  of  the  continuous  variable  Z2(vx)  when  an  incorrect  answer  to  Item  2  is 
observed,  cr 2{Z2  |  vx,u2  =  0),  is  provided  by 


<t2(Z2  |  vXlu2  =  0)  = 


<t2(Z2  |  Vj  ,u2  =  0) 


=  1  - 


cr2(Z2  |  vx) 

</>[y2(vi)]  I  <£[y2(v,)] 


e2(v  i) 


e2(v  i) 


+  r2(vi) 


(5.3.73) 


where  cr2(Z2  |  vx,u2  =  0)  is  the  variance  of  the  continuous  variable  Z ra  as  originally  scaled  after 
both  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable 
Zj  as  indicated  by  the  outcome  vx  and  the  effect  of  explicit  selection  as  indicated  by  u2,  the 
realization  of  the  binary  variable  f/2;  cr2(Z2 1  v,)  is  the  variance  of  the  continuous  variable  Z2  after 
the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Zx  as 
indicated  by  the  outcome  v,;  y2(v,)  is  the  point  of  dichotomization  on  Z2(v,),  the  standardized 
form  of  the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental  selection  resulting  from 
explicit  selection  on  the  continuous  variable  Zt  as  indicated  by  the  outcome  vx\  (t>[y2(v\)]  is  the 
density  in  the  standard  normal  distribution  evaluated  at  y2(v,);  and  Q2(vx)  is  the  probability  of  an 
incorrect  answer  to  Item  2  subsequent  to  the  outcome  v, . 

Given  the  three-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 

vj: 


The  variance  of  the  continuous  variable  ^(vj),  when  a  correct  answer  to  Item  2  is  observed, 
ct2(Z2  |  v\,u2  =  1),  is  provided  by: 
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cr2(Z2  |  v\,u'2  =  1)  = 


o-2(Z2  |  v, ,u2  =  1) 
or2(Z2 1  vj) 


(1  -  £2)  </>  [72(^1)]  |  (1  -  C2)  [-y2(v! )1 

1  P2(V  i) 


(5.3.74) 


where  a 2(Z2 1  v\,u2  =  1)  is  the  variance  of  Z2  as  originally  scaled  after  both  the  effect  of  incidental 
selection  resulting  from  explicit  selection  on  the  continuous  variable  Z,  as  indicated  by  the  outcome 
vj,  and  the  effect  of  explicit  selection  as  indicated  by  u2,  the  realization  of  the  binary  variable 
U2,  o2(Z2  I  v I)  is  the  variance  of  the  continuous  variable  Z2  after  the  effect  of  incidental  selection 
resulting  from  explicit  selection  on  the  continuous  variable  Z,  as  indicated  by  the  outcome  vj;  c2 
is  the  coefficient  of  guessing  for  Item  2;  -y2(vj)  is  the  point  of  dichotomization  on  Z2(vj),  the 
standardized  form  of  the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental  selection 
resulting  from  explicit  selection  on  the  continuous  variable  Z,  as  indicated  by  the  outcome  vj ; 
4>[ y2(vi)]  is  the  density  in  the  standard  normal  distribution  evaluated  at  -y2(v', );  and  P2(vj)  is  the 
probability  of  a  correct  answer  to  Item  2  subsequent  to  the  outcome  vj. 


The  variance  of  the  continuous  variable  Z2(vj),  when  an  incorrect  answer  to  Item  2  is 
observed,  cr2(Z2 1  vj,«2  =  0),  is  provided  by 


ct2(Z2  I  vj  ,u2  =  0) 


o-2(Z2  I  v  1 , 11 2  =  0) 
o-2(Z2  I  vj) 


=  1 


02(fj) 


Qiiv  j) 


+  Jliv',)  f, 


(5.3.75) 


where  a2(Z2  |  vj ,u2  --  0)  is  the  variance  of  the  continuous  variable  Z2  as  originally  scaled  after 
both  the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable 
Z2  as  indicated  by  the  outcome  vj  and  the  effect  of  explicit  selection  as  indicated  by  w2,  the 
realization  of  the  binary  variable  U2\  cr(Z2 1  vj)  is  the  variance  of  the  continuous  variable  Z2  after 
the  effect  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Z2  as 
indicated  by  the  outcome  vj;  y2(vj)  is  the  point  of  dichotomization  on  Z2(vj),  the  standardized 
form  of  the  continuous  variable  Z2  subsequent  to  the  effect  of  incidental  selection  resulting  from 
explicit  selection  on  the  continuous  variable  Z,  as  indicated  by  the  outcome  vj;  </>[y2(vj)]  is  the 
density  in  the  standard  normal  distribution  evaluated  at  y2(vj);  and  <22(vj)  is  the  probability  of 
not  recognizing  the  correct  alternative  to  multiple-choice  Item  2  subsequent  to  the  outcome  vj. 


The  submodel  and  outcome  specific  forms  (5.3.57)  through  (5.3.60)  and  (5.3.72)  through  (5.3.75)  will 
be  used  in  later  derivations.  These  later  derivations  will  provide  answers  to  the  queries,  “Which  item  should  be 
given  second?”  and  “What  is  the  variance  of  ability  given  the  binary  score  on  this  second  item?” 

Which  Item  Second?  At  this  point,  each  item  g  excluding  that  item  subscripted  g(l)  is  potentially  the 
second  item  in  the  tailored  test.  Which  of  these  Zg(vf)  becomes  Z2(vf)  is  then  the  question.  As  before,  the 
possible  second  entries  in  v*  must  be  probabalistically  anticipated  in  order  to  obtain  the  most  informative  entry. 
To  do  this,  one  rewrites  (5.3.55)  for  the  first  two  equalities  as 

o-2(6>*|vf,f/p[l  -  p2(Zg,e\v?,U*)]  =  cr2(0*  |  vf)[  1  -p2(Z,,0|vf)]  for  all  g  where  g¥=g(X),  (5.3.76) 

which  may  be  rearranged  and  transposed  as 

a\e*  I  vf,U*)  =  cr2(0*  |  vf)[l  -  p2(Z,,0  |  vf] 

+  cr2(0*  |  vft/*)p2(Z,,0  |  v*,f/J)  for  all  g  where  g*g"\  (5.3.77) 


Also,  since  any  remaining  Z/v?)  is  potentially  Z2(vf)  and  the  second  entry  in  v*  must  be  anticipated,  the  first 
two  equalities  in  (5.3.53)  may  be  rewritten  as 


p(Zg,6 


v*,U*) 


o-(e*  |  vfM*) 

a(Zg  |  v*,U*) 


p(Zg,0 


*,  o~(0*  I  vf) 

o<Zjvf) 


for  all  g  where  g^g(,). 


(5.3.78) 
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Upon  squaring  (5.3.78),  one  obtains 


p\zg,o\  v*,u*) 


cr2(0*  |  yf,C/*) _ 2/V  ^  a2(0*  |  vf) 


cr2(Zg  |  v,  ,[/*) 


=  p2(Z  ,0  |  v, ) 


v\Zg  |  v, ) 


where  an  explicit  solution  for  p2{Zg,0  \  vf,£/J)  yields 


Az„e  |  =  Az,,9 1  ,r> 

H  g  g  H  g  11  cr2(Z„  |  vf)  <r2(0*  |  vf,f/|) 


for  all  g  where  g#g(1),  (5.3.79) 


for  all  g  where  g^g(l\  (5.3.80) 


which  may  be  substituted  into  (5.3.77).  After  this  substitution,  one  has,  through  rearranging  terms, 
a2(0*  |  »?,£/*) 

=  (t2(0*  |  vf)  1 1  -  p2(Zg,0  |  vf) 

as  the  variance  of  ability  given  vf  for  the  realizations  of  U*  which  can  be  rendered  both  submodel  and  outcome 
specific. 

For  the  two-parameter  normal  ogive  submodel,  where  vf  =  vl  and  U*  =  Ug,  and  given  a  correct  answer 
to  a  potential  second  itemg,  ( ug  =  1),  a  substitution  from  (5.3.72)  into  (5.3.81),  along  with  some  rearrangement, 
yields 

cr2(0*  |  vitug  =  I) 


1  - 


o-2(Z, 


vf,t/f) 


cr2(Z„ 


Vi) 


for  all  g  where  g^g(1)  (5.3.81) 


=  cr2(69*  |  v,) 


"  P2(Zg9G 


,  tly'ivi)] 

V.)  - * - 

W 


4>[y:,(y  i)] 

W 


for  all  g  where  g^g{l)  (5.3.82) 


as  the  variance  of  ability  given  the  correct  answer.  Under  the  same  circumstances  and  given  an  incorrect  answer 
to  a  potential  second  item  g,  (ug  =  0),  a  substitution  from  (5.3.73)  into  (5.3.81),  along  with  subsequent 
rearrangement,  provides 

cr2((9*  |  v{,ug  =  0) 


=  cr2(Q*  |  V,) 


1  -  p2(Zg,0  I  V,) 


MyjXvQ] 

Qg(vx) 


e,(v,) 


for  all  g  where  gZ-g(l)  (5.3.83) 


as  the  variance  of  ability  given  the  incorrect  answer. 

For  the  two-parameter  normal  ogive  submodel,  where  vf  =  v,  and  U*  —  U g ,  substitutions  from  (5.3.57), 
(5.3.58),  (5.3.82)  and  (5.3.83)  for  a  potential  second  item  g  into  (5.2.4)  move  one  closer  to  an  answer  to  the 
query:  Which  item  second?  After  these  substitutions,  one  has 


a2(0*  |  vuU.) 


Pg(v i)  or2(6*  |  v,)  1  -  p2(Z ’  6  \  v,) 


<£[%<>))]  I  </>[y„(v,)] 


P'(V,)  I  P,(V.) 


-  y,(v,) 


+  0J?(Vi)o-2(0*  I  V,)  y  1  -  p-(Zg,0\  V,) 
for  all  g  where  g5^g(1>. 


<^[y»(vi)l  ( 4>[y,(v ,)] 


QM)  {  e?(v,) 


+  rs(vi) 


(5.3.84) 


which  simplifies  using  steps  identical  to  those  of  earlier  developments,  from  (5.3.14)  through  (5.3.18),  to 


%ua2(0*  |  vuUg)  =  a2(6*  |  v,)  I  1  -p2(Zg,6\  v,) 


{0[ygivi)]}2 

Pg(V\)Qg(V  i) 


for  all  g  where  g^g(1).  (5.3.85) 


The  item  g,  excluding  item  g(1),  for  which  (5.3.85)  is  a  minimum,  is  then  the  most  informative  second  item 
given  the  two-parameter  normal  ogive  submodel.  Note  that  the  variance  of  ability,  cr2(Q*  |  v,),  is  a  constant  in 
the  evaluation  of  item  g  excluding  item  g(1).  Thus  the  maximum  of  the  second  term  within  the  large  parentheses 
in  (5.3.85)  for  the  remaining  g, 
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for  all  g  where  gZg(l), 


(5.3.86) 


max  p2(Zg,6  j  v,) 


{<M%t(yi)]}2 

Pg(9l)Qti*l) 


will  yield  an  identical  g  to  that  provided  by  the  full  evaluation  of  (5.3.85)  for  the  remaining  g\  and,  obviously, 
the  minimum  over  the  remaining  g  of  the  reciprocal  of  the  second  term  within  the  large  parentheses  in  (5.3.85), 


min 

8 


p2{Zg,0  |  V,)  {<t>[yg(vx)]}2 


for  all  g  where  gi^g 


d) 


(5.3.87) 


will  yield  the  same  g  as  would  the  full  evaluation  of  (5.3.85)  for  the  remaining  items.  Either  (5.3.86)  or  (5.3.87) 
may  then  be  used  to  choose  the  most  informative  second  item.  While  the  quantities  provided  by  (5.3.85)  yield 
more  information  on  each  remaining  item,  either  (5.3.86)  or  (5.3.87)  provides  an  identical  choice  of  item.  The 
use  of  either  will  introduce  a  computational  savings. 

For  the  three-parameter  normal  ogive  submodel,  where  v,  =  vj  and  U*  =  U'g,  and  a  correct  answer  to 
a  potential  second  item  g,  (u'g  =  1),  is  the  anticipated  outcome,  a  substitution  from  (5.3.74)  into  (5.3.81),  along 
with  some  rearrangement,  yields 

cr2(0*  |  vj ,ug  =  1) 


=  v\e*  |  vj)  I  i  -  p2(z„,e  |  vi) 


(1  -  c,)<My,(V,)][  (1  -  cx)<t>[yx(v j)] 


W) 


P'M) 


for  all  g  where  g¥^g 


0) 


(5.3.88) 


as  the  variance  of  ability  given  the  correct  answer.  Under  the  same  circumstances  and  given  an  incorrect  answer 
to  a  potential  second  item  g,  (ug  =  0),  a  substitution  from  (5.3.75)  into  (5.3.81),  along  with  some  rearrangement, 
provides 

cr2(0*  |  v\,ug  =  0) 


=  a2(0*  |  vi) 


p2(Zg,6 


Vi)  - * - 

Q,W 


)j 

e*(v  a 


for  all  g  where  g^g(I) 


(5.3.89) 


as  the  variance  of  ability  given  the  incorrect  answer. 

For  the  three-parameter  normal  ogive  submodel,  where  v*  =  vj  and  U*  =  U'g,  substitutions  from 
(5.3.59),  (5.3.60),  (5.3.88),  and  (5.3.89)  for  a  potential  second  item  g  into  (5.2.4)  move  one  closer  to  an  answer 
to  the  query:  Which  item  second?  After  these  substitutions,  one  has 

%u.o2{0*  |  v\,U'g) 


=  P'(v[)cr2(0*  |  vi)  1  -  p2(Z  O  |  vi) 


„  0  -  c.)^[y.(vi)]J(l  -  cg)<l>[yJv[)] 


Pfr  i) 


Pfr  i) 


-  3*(vi) 


+  e;(v,)^(S*  I ",)  (I  -  pHz„e\  v,)  +  r.(r,) 


for  all  g  where  % 


(5.3.90) 


which  simplifies  using  steps  identical  to  those  of  earlier  developments,  that  is  from  (5.3.23)  through  (5.3.30), 
to 


lUga\e*  I  v\,U’g) 

=  a2(0*  I  vi)  (  1  -  p2(Zg, 0  I  v i ) ( 1 


c«) 


{^[ry(vi)]}2 

Pg(v  i)G,(vi) 


for  all  g  where  g^g 


0) 


(5.3.91) 


In  (5.3.91)  one  now  has  a  computationally  convenient  solution  for  the  evaluation  of  each  remaining  item  g.  That 
item  g  for  which  (5.3.91)  is  a  minimum  is,  then,  the  most  informative  second  item  given  the  three-parameter 
normal  ogive  submodel.  Again  note  that  the  variance  of  ability,  cr2(0*  |  v;),  is  a  constant  in  the  evaluation  of 
all  the  remaining  items.  Thus  the  maximum  over  the  remaining  items  of  the  second  term  within  the  large 
parentheses  in  (5.3.91), 
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for  all  g  where  g5^g(1), 


(5.3.92) 


max  p2(Zg,0  |  vj)(l 


)  {^[^(vj)]}2 

Cg  P'K(v\)Qg(y\) 


will  yield  an  identical  g  to  that  provided  by  the  full  evaluation  of  (5.3.91)  for  the  remaining  items;  and,  obviously, 
the  minimum  over  the  remaining  g  of  the  reciprocal  of  the  second  term  within  the  large  parentheses  in  (5.3.91), 


min 

x 


_ P'x(y\)Qf>(y\) _ 

p2(Zg,e  |  v;)(i  -  cg){(f)[yg(v\)]}2 


for  all  g  where  g^g(1), 


(5.3.93) 


will  yield  the  same  g  as  would  the  full  evaluation  of  (5.3.91)  for  the  remaining  items.  Either  (5.3.92)  or  (5.3.93) 
may  then  be  used  to  choose  the  second  item.  While  the  quantities  provided  by  (5.3.91)  are  more  informative 
with  respect  to  each  remaining  item,  either  (5.3.92)  or  (5.3.93)  may  be  used  to  choose  the  identical  remaining 
item.  The  use  of  either  will  provide  a  computational  savings. 

At  this  juncture,  it  may  be  assumed  that  the  second  item  has  been  chosen.  In  the  case  of  the  two-parameter 
submodel,  one  may  have  used  either  (5.3.85),  (5.3.86),  or  (5.3.87)  for  this  purpose.  In  the  case  of  the  three- 
parameter  normal  ogive  submodel,  one  may  have  used  either  (5.3.91),  (5.3.92),  or  (5.3.93)  for  this  purpose. 
This  item  is  subscripted  by  n  within  the  tailored  test.  Because  this  is  the  second  item  in  the  tailored  test,  its 
subscript  takes  on  the  value  2. 

What  Is  the  Estimate  of  Ability  Given  the  Binary  Score  on  this  Second  Item?  At  this  point,  it  is  known 
that:  (a)  Z2(vf)  is  in  standard  score  form;  (b)  @*(vf)  is  in  its  original  scale  and  is  distributed  about  a  mean 
fi(0*  |  vf)  with  a  variance  <r2(0*  |  vf );  (c)  Z2(vf)  and  0*(vf)  possess,  given  the  updating  assumption,  a  joint 
bivariate  normal  distribution;  and  (d)  given  this  assumption,  the  property  of  invariance  obtains.  Since  parallel 
conditions  led  to  the  solutions  provided  in  (2.2.23),  (2.2.29),  (3.2.15),  and  (3.2.16),  one  can  now  interpret  these 
equations  into  the  present  context  as  estimators  of  ability: 


p(Q*  I  v,,«2  =  1)  =  p(0*  I  v,)  +  p(Z2,e  I  v,)cr(0*  I  V\)p{Z2  I  V],m2  =  1)  (5.3.94) 

for  a  correct  answer  to  Item  2  given  the  two-parameter  normal  ogive  submodel; 

p(6*  |  Vj ,u2  =  0)  =  p(0 *  V])  +  p(Z2,0  |  V|)cr( 0*  |  v,)  p(Z2  |  V] ,u2  =  0)  (5.3.95) 

for  an  incorrect  answer  to  Item  2  given  the  two-parameter  normal  ogive  submodel; 

P(0*  I  v;,«2  =  1)  =  jt(0*  |  vj)  +  p(Z2,0|  v;)cr(0*  I  v\)i±(Z2  I  v\,u2  =  1)  (5.3.96) 

for  a  correct  answer  to  Item  2  given  the  three-parameter  normal  ogive  submodel;  and 

M0*  I  vi,«2  =  0)  =  m(0*  I  vj)  +  p(Z2,0  I  v\)a(Q*  I  v\ )(Ji(Z2  \  v\,u2  =  0)  (5.3.97) 

for  an  incorrect  answer  to  Item  2  given  the  three-parameter  normal  ogive  submodel. 

In  this  context,  then,  the  generalized  expression  for  the  estimator  of  ability  may  be  written  as 

p(0*  |  v*,U%)  =  p(0*  |  vf)  +  p(Z2,0  |  v*)a(0*  |  v*)p(Z2 1  vf,U*)  (5.3.98) 

where  multiplying  and  dividing  the  rightmost  term  by  a(Z2  \  vf)  yield 

p(0*  I  v*,ut)  =  /a(0*  |  vf)  +  p(Z2,0  I  vf)  (j{6  |  T 1  cr(Z2  I  vf)p.(Z2 1  vf ,U2).  (5.3.99) 

<t(Z2  |  v, ) 

But  after  substituting  from  (5.3.67)  into  (5.3.99)  one  has 

p(0*  I  vf  ,U*)  =  I  vf)  +  p(Z 2,0  I  vf)  p(Z2  I  vf,U2)  (5.3.100) 

a(Z2  |  v, ) 


where  the  regression  coefficient  in  the  rightmost  expression  in  (5.3.100)  now  corresponds  to  that  given  as  the 
equality  in  the  middle  of  (5.3.53).  After  a  substitution  from  the  rightmost  equality  of  (5.3.67)  into  (5.3.100) 
one  obtains,  after  some  rearrangement. 
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(5.3.101) 


P-{0*  |  v*,U*)  =  M(0*  I  v*)  -  p(Z2,0 


V|) 


a(6* 


V|  ) 


4-  p(Z2,0 


*  \ 

Vl  ) 


C7(  0* 


*\ 
*1 ) 


o-(Z2  j  v, ) 


&(Z2 
P-(Z2 1 


*\ 

h) 


p,(Z2 


Vl) 


an  equation  that  is  reminiscent  of  the  raw  score  formula  in  linear  regression.  In  (5.3.101),  the  first  two  terms 
on  the  right  side  of  the  equal  sign,  after  the  subtraction  is  completed,  form  the  intercept.  The  remaining  term 
on  this  right  side  is  the  weighted  mean  of  Z2  as  originally  scaled,  given  the  previous  outcome  vf  and  the  observed 
outcome  U2  .  Because  of  (5.3.101),  it  is  known  that  for  each  observed  outcome  U*  given  vf  that 
^(0*  |  vf,£/f)  IS  ^e  coordinate  of  0*(vf)  for  a  point  on  the  line  of  regression  of  0*(vf )  on  Z2(vf)  where  this 
point’s  coordinate  on  Z2(vf)  is  given  by  /i(Z2|vf  ,£/*)•  Remember,  0*(vf)  is  in  the  original  scale  of  0*. 

Convenient  expressions  can  now  be  derived  for  the  estimators  of  ability  for  the  outcome  of  the  encounter 
between  the  individual  and  Item  2  given  the  previous  outcome  vf.  Under  the  two-parameter  normal  ogive 
submodel,  a  substitution  from  (5.3.68)  into  (5.3.100)  provides 


p.{6*  |  vuu2  =  1)  =  p.(0*  |  v,)  +  p(Z2,0  |  v, )a(0*  |  v,)  (5.3.102) 

P 2(^1 ) 

as  the  estimator  of  ability  when  a  correct  answer  is  observed;  and  a  substitution  from  (5.3.69)  into  (5.3.100) 
yields 

,  ,  6\  Wv,)l 

p,(9*  |  v, ,u2  =  0)  =  p,(6*  |  v,)  -  p(Z2,0  |  v,)<t(0*  |  v,)  -  (5.3.103) 

Ql\V\ ) 


as  the  estimator  of  ability  when  an  incorrect  answer  is  observed.  Under  the  three-parameter  normal  ogive  submodel, 
a  substitution  from  (5.3.70)  into  (5.3.100)  provides 

1*0*  |  v\,u2  =  1)  =  ixiO*  |  v,)  +  p(Z20  |  vi  )tr(0*  |  vj)  (1  -  c2)  ^  (5.3.104) 

F 2V^l) 


as  the  estimator  of  ability  when  a  correct  answer  is  observed;  and  a  substitution  from  (5.3.71)  into  (5.3.100) 
yields 

p,(Q*  I  v\,u2  =  0)  =  p.(6*  I  vj)  -  p(Z2,0  |  v\)a(0*  \  vj)  (5.3.105) 


as  the  estimator  of  ability  when  an  incorrect  answer  is  observed.  In  (5.2. 102)  through  (5.3. 105)  one  has  expressions 
that  are  convenient  for  the  computation  of  ability  for  either  outcome  in  the  encounter  between  the  individual  and 
Item  2,  given  both  the  two-  and  three-parameter  normal  ogive  submodels. 

What  Is  the  Variance  of  Ability  Given  the  Binary  Score  on  the  Second  Item?  In  deciding  which  item  to 
choose  as  the  second  item  in  the  tailored  test,  it  was  necessary  to  obtain  solutions  for  the  variances  of  ability 
given  the  realizations  of  U* .  The  generalized  expression  was  derived  in  (5.3.81)  and  was  rendered  submodel 
and  outcome  specific  in  (5.3.82),  (5.3.83),  (5.3.88),  and  (5.3.89).  In  this  context,  it  is  necessary  merely  to  alias 
the  subscript  of  the  chosen  item  g(2)  by  n  in  each  of  these  equations  to  obtain  the  appropriate  expressions. 

For  n  equal  to  2,  the  generalized  expression  for  the  variance  of  ability  given  vf  and  the  realizations  of 
U*  is  obtained  from  (5.3.81)  through  the  aliasing  of  subscripts  as 


cr2(0*  |  v*,Ui)  =  0"2(0* 


Vi) 


i  -p\z2,e 


*\ 

V,) 


cr2(Z2 


*  r  r*\ 

,U2) 


a2(Z2 


Vl) 


(5.3.106) 


One  makes  certain  that  the  items  subscripted  g(I)  and  g{2)  are  distinct  items. 

For  the  two-parameter  submodel,  where  vf  =  Vj  and  U*  =  U2i  and  a  correct  answer  to  Item  2, 
( u2  =  1),  is  observed  the  aliasing  of  the  subscripts  in  (5.3.82)  provides 


<x2(0*  I  v,,m2 


1)  =  cr2(0*  |  v,) 


1  -  p2(Z2,6  |  v,) 


W,) 


<MT2(Vi)] 

P2(Vi) 


(5.3.107) 


as  a  convenient  expression  for  the  calculation  of  the  variance  of  ability.  For  the  same  circumstances  and  an 
incorrect  answer  to  Item  2,  (k2  =  0),  the  aliasing  of  the  subscripts  in  (5.3.83)  yields 


a2(0*  |  v,,w2  =  0)  =  <t2(0*  |  Vj)  I  1  —  p2(Z2,Q  |  Vj) 


<A[y2<»'i)]  j  4>[y 2(vi)] 


Qi(v  i) 


e2(v,) 


+  y2iy\) 


(5.3.108) 
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as  a  convenient  expression  for  the  calculation  of  the  variance  of  ability. 

For  the  three-parameter  submodel,  where  vf  =  v\  and  U*  =  U'2,  and  a  correct  answer  to  Item  2, 
0*2  =  1),  is  observed  the  aliasing  of  the  subscripts  in  (5.3.88)  provides 

a2(0*  |  v\,u2  =  1) 


=  a2(0*  |  vj) 


Pz(Z2,0 


(1  -  c2)4>[ y2(vj)] 

Pi(y i) 


(1  -  c2)<l>[y2(v\)] 

Pi(y\) 


(5.3.109) 


as  a  convenient  expression  for  the  calculation  of  the  variance  of  ability.  For  the  same  circumstances  and  an 
incorrect  answer  to  Item  2,  (u2  =  0),  the  aliasing  of  the  subscripts  in  (5.3.89)  yields 


a2(0*  |  v\,u2  =  0) 


cr2(0*  |  v,) 


1  ~P2(Z2,6 


0h^(vi)j 

Q2(y\) 


0h^Oo)] 

Qi(y\) 


+  'ftO’i) 


(5.3.110) 


as  a  convenient  expression  for  the  calculation  of  the  variance  of  ability. 

Can  This  Process  of  Choosing  and  of  Estimating  Ability  and  Its  Variance  Be  Extended  to  a  Third 
Item?  Given  the  two-parameter  submodel,  one  begins  tailoring  the  second  item  in  an  individual’s  test  with 
p.(0*  |  v,),  a2(0*  |  v,)  and,  consequently,  a(0*  |  v,)  as  known  values.  These  values  represent  the  second 
estimate  of  this  individual’s  ability,  its  variance,  and  its  standard  deviation.  Also  a*  and  b*  are  known  for  all 
g.  Given  a*  and  cr(0*  |  v,),  p(Zg,0  |  v,)  can  be  obtained  for  the  remaining  items  with  subscripts  g  through  the 
use  of  (5.3.48).  Given  a*,  b*,  /*( 0 *  |  v,),  and  <j\0*  [  v,),  yg(v,)  can  be  obtained  for  the  remaining  items  with 
subscript  g  through  the  use  of  (5.3.50);  and  given  yg(v,),  Pg(v,)  and  Qg(v j)  can  be  obtained  for  the  remaining 
items  with  subscript  g  through  the  use  of  (5.3.57)  and  (5.3.58),  because  these  remaining  items  are  all  eligible 
to  be  chosen  as  the  second  item.  The  density  at  y/v,)  is  given  by 


=  (2tt)  5  exp{-.5[yg(vf)]2}  (5.3.111) 

for  the  remaining  items  with  subscript  g  because  this  relationship  obtains  by  definition.  Thus,  one  can  use 
(5.3.85),  or,  consequently,  (5.3.86)  or  (5.3.87)  to  choose  the  second  item,  because  the  required  inputs  for  these 
equations  are  known  or  readdy  obtainable.  What  is  known  or  readily  obtainable  at  this  juncture  is  also  sufficient 
for  the  estimation  of  ability  and  the  variance  of  ability.  Given  the  chosen  item,  g(2\  its  subscript  is  aliased  by 
n  where  n  equals  2.  Then  Item  2  is  presented  to  the  individual.  If  this  individual’s  answer  to  Item  2  is  correct 

(5.3.102)  is  used  to  estimate  this  individual’s  ability;  and  (5.3.107)  is  used  to  estimate  the  variance  of  this 
individual’s  ability  estimate.  If  this  individual’s  answer  to  Item  2  is  incorrect,  (5.3. 103)  is  used  to  estimate  this 
individual  s  ability,  and  (5.3.108)  is  used  to  estimate  the  variance  of  this  individual’s  ability  estimate. 

Given  the  three-parameter  submodel,  one  begins  tailoring  the  second  item  in  an  individual’s  test  with 
P-(0*  |  vi),  cr2(0*  |  vj),  and  consequently,  cr(0*  |  v,),  as  known  values.  These  values  represent  the  second 
estimate  of  this  individual’s  ability,  its  variance,  and  its  standard  deviation.  Also,  a*,  b* ,  and  c*  are  known 
for  all  g.  Given  a*  and  a(0*  |  v]),  p{Zg,0  |  vj)  can  be  obtained  for  the  remaining  items  with  subscript  g  through 
the  use  of  (5.3.48).  Given  a*,  b*,  n(0*  |  vj),  and  a2(0*  |  vi),  yg(vj)  can  be  obtained  for  the  remaining  items 
with  subscript  g  through  the  use  of  (5.3.50);  and  given  yg(vj),  Pg(v\ )  and  Qg(v',)  can  be  obtained  for  the  remaining 
items  with  subscript  g  through  the  use  of  (5.3.59)  and  (5.3.65),  because  these  remaining  items  are 
all  eligible  to  be  chosen  as  the  second  item.  Notice  that  cg(vj)  is  merely  cg,  as  indicated  in  (5.3.51),  when  one 
considers  all  items  eligible  to  be  chosen  as  the  second  item.  The  density  at  yg(vi),  f>[ yg(vj)],  is  obtained  for 
the  remaining  items  with  subscript  g  through  the  use  of  (5.3. 1 1 1).  Thus  one  can  use  (5.3.91)  or,  consequently, 
(5.3.92)  or  (5.3.93)  to  choose  the  second  item  because  the  required  inputs  for  these  equations  are  known  or 
readily  obtainable.  What  is  known  or  readily  obtainable  at  this  juncture  is  also  sufficient  for  the  estimation  of 
ability  and  the  variance  of  ability.  Given  the  chosen  item  g(2),  its  subscript  is  aliased  by  n  where  n  equals  2. 
Then  Item  2  is  presented  to  the  individual.  If  this  individual’s  answer  is  correct,  (5.3.104)  is  used  to  estimate 
this  individual’s  ability;  and  (5.3.109)  is  used  to  estimate  the  variance  of  this  individual’s  ability  estimate.  If 
this  individual’s  answer  to  Item  2  is  incorrect,  (5.3. 105)  is  used  to  estimate  this  individual’s  ability;  and  (5.3.1 10) 
is  used  to  estimate  the  variance  of  this  individual’s  ability  estimate. 

The  generalized  outcome  vector  v*_j  or  v2  now  contains  v,  and  one  of  four  possible  entries: 
u2[ga>]  =  1  >  or  u2\gC-)\  =  0,  «2(*<2>i  =  1,  or  u'2[g ,21]  =  0,  where  the  bracketed  notation  in  the  subscript  denotes  the 
ability  bank  subscript  of  the  second  chosen  item.  One  now  seeks  the  nth  or  the  third  item.  The  outputs  of 

(5.3.102) ,  (5.3.103),  (5.3.104),  and  (5.3.105)  may  be  rendered  in  generalized  form  as  p.(0*  |  v*);  and  the 
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outputs  of  (5.3.107),  (5.3.108),  (5.3.109),  and  (5.3.110)  may  be  rendered  in  generalized  form  as  <r2(0*  |  v2). 
At  this  juncture  p (0*  |  v2)  and  cr2(0*  |  v*)  are  known.  Of  course,  also  known  are  a*  and  b*,  in  the  two- 
parameter  case,  and  a*>  b*,  and  c*  in  the  three-parameter  case,  for  all  the  items  in  the  ability  bank. 

In  the  following  developments  it  will  be  established  that  enough  is  known  for  the  choice  of  item,  ability 
estimation,  and  the  estimation  of  the  variance  of  ability  for  a  tailored  test  of  three  or  more  items.  These 
developments  also  follow  from  previous  assumptions,  those  underlying  selection  theory  and  the  restricted  updating 
procedure. 

Under  the  restricted  updating  procedure  the  distribution  of  0*(v2),  the  distribution  of  0*  resulting  from 
incidental  selections  due  to  explicit  selections  on  Zj  and  Z2(vf ),  is  assumed  normal.  That  this  assumption  provides 
a  workable  approximation  was  discussed  and  illustrated  earlier.  As  a  consequence,  Z3(v* ),  the  distribution  of 
Z3  resulting  from  incidental  selections  due  to  explicit  selections  on  Zx  and  Z2(vf )  is  also  normal  to  a  workable 
approximation.  The  reason  for  the  workability  of  this  approximation  is  that  Z3(v2  )  is  a  linear  combination  of 
0*(v2),  the  variable  of  ability,  and  a  homoscedastic  random  error  variable  which  is  normally  distributed.  The 
random  error  variables  are  assumed  under  the  basic  model  to  be  independent  from  item  to  item.  Explicit  selections 
on  Zj  and  Z2(vf)  have  no  effect  on  the  homoscedastic  random  error  in  Z3.  As  a  result,  the  joint  distribution  of 
Z3(v* )  and  0*(v2)  is  bivariate  normal  to  a  workable  approximation. 

Because  bivariate  normality  is  a  workable  approximation,  convenient  expressions  are  now  sought  for 
p(Z3 , 0  |  v2),  the  correlation  between  Z3(v2)  and  0*(v* ),  and  y3(v2),  the  point  of  dichotomization  on  Z3(v2), 
or  synonomously,  the  continuous  variable  Z3(v*)  after  its  standardization  to  a  mean  of  zero  and  variance  of 
unity.  These  expressions  will  allow  a  repetition  of  the  application  of  the  selection  or  rejection  analogy  in  the 
tailored  testing  context.  One  will  then  be  considering  explicit  selection  or  explicit  rejection  on  Z3(v* ),  standardized 
Z3(v*),  where  the  “cut  score”  is  y3(v2). 

Since  the  derivations  leading  to  convenient  expressions  for  p(Z3,0  |  v* )  and  y3(v* )  are  of  considerable 
length  and  detail,  only  the  principal  results  are  presented  here.  These  derivations  may  be  found  in  Section  5.4. 
In  the  course  of  these  derivations,  solutions  are  also  found  for  the  parameters  a3(v* ),  item  discriminatory  power, 
and  fc3(v*),  item  difficulty.  These  parameters  are  those  for  Item  3  that  are  appropriate  for  0*(v2),  or  the 
continuous  variable  of  ability  given  the  generalized  outcome  vector  v2  in  standardized  form.  These  parameters 
provide  the  property  of  invariance. 

The  presented  equations  apply  to  any  potential  third  item  in  the  tailored  test.  At  this  juncture,  there  are 
(p  —  2)  items  remaining  in  the  ability  bank  as  possible  choices  for  a  third  item. 

In  deriving  a  convenient  expression  for  p(Z3,0  |  v2),  it  is  necessary  to  obtain  a3(v2),  the  item  parameter 
of  discriminatory  power  that  is  appropriate  for  0*(v* ),  or  the  standardized  form  of  the  continuous  variable  of 
ability  subsequent  to  the  outcomes  recorded  in  the  generalized  vector  v* .  The  solution  for  this  parameter  is 
provided  by 

a3(v2)  =  a*  ^(0*  |  v2),  (5.3.112) 

where  a*  is  the  parameter  of  item  discriminatory  power  appropriate  for  0*,  as  known;  and  <r(0*  |  v* )  is  the 
standard  deviation  of  0*  given  the  generalized  outcome  vector  v* ,  as  provided  by  the  square  root  of  either 
(5.3. 107)  or  (5.3. 108)  in  the  case  of  the  two-parameter  normal  ogive  submodel,  or  of  either  (5.3. 109)  or  (5.3. 1 10) 
in  the  case  of  the  three-parameter  normal  ogive  submodel. 

A  convenient  expression  for  the  correlation  between  Z3  and  0*  given  the  generalized  outcome  vector 
v*  is  provided  by 


p(Z3,0  |  v2) 


_  a* cr(0*  |  v2) 

{l  +  [«3(v*)]2}-5  {l  +  [fl?o<0*  |  v*)]2}-5’ 


(5.3.113) 


where  a3(v2)  is  the  parameter  of  item  discriminatory  power  appropriate  for  0*(v2),  as  provided  by  (5.3.112); 
a*  is  the  parameter  of  item  discriminatory  power  appropriate  for  0*,,as  known;  and  <x(0*  |  (v* )  is  the  standard 
deviation  of  0*  given  the  generalized  outcome  vector  v* ,  as  provided  by  the  square  root  of  either  (5.3. 107)  or 
(5.3.108)  in  the  case  of  the  two-parameter  normal  ogive  submodel,  or  of  either  (5.3.109)  or  (5.3.110)  in  the 
case  of  the  three-parameter  normal  ogive  submodel. 

In  deriving  a  convenient  expression  for  y3(v* ),  it  is  necessary  to  obtain  a  solution  for  fr3(v* ),  the  parameter 

of  item  difficulty  appropriate  for  0*(v2),  or  the  continuous  variable  of  ability  given  the  generalized  outcome 
vector  v*  in  standardized  form.  The  solution  for  this  parameter  is  provided  by 
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(5.3.114) 


b3(vt) 


bj  ~  Mg*  1  v*) 

ct(0*  |  v*) 


where  b*  is  the  parameter  of  item  difficulty  appropriate  for  0*,  as  known;  p.(0*  |  v* )  is  the  estimator  of  ability 
as  provided  by  either  (5.3.102)  or  (5.3.103)  in  the  case  of  the  two-parameter  normal  ogive  submodel,  or  either 
(5.3.104)  or  (5.3.105)  in  the  case  of  the  three-parameter  normal  ogive  submodel;  and  <x(0*  |  v*)  is  the  standard 
deviation  of  0*  given  the  generalized  outcome  vector  v* ,  as  provided  by  the  square  root  of  either  (5.3.107)  or 
(5.3.108)  in  the  case  of  the  two-parameter  normal  ogive  submodel,  or  of  either  (5.3.109)  or  (5.3.110)  in  the 
case  of  the  three-parameter  normal  ogive  submodel. 

A  convenient  expression  for  the  point  of  dichotomization  on  Z3(v*),  the  standardized  form  of  the  con¬ 
tinuous  variable  Z3  given  the  generalized  outcome  vector  v* ,  is  provided  by 


73(^2)  = 


bj  ~  M0*  |  v* ) 

[(a*)-2  +  cr2(Q*  |  v*)]-5’ 


(5.3.115) 


where  a*  and  b *  are  the  parameters  of  item  discriminatory  power  and  item  difficulty,  respectively,  that  are 
appropriate  for  0*,  as  known;  p(0*  |  v* )  is  the  estimator  of  ability,  as  provided  by  either  (5.3.102)  or  (5.3.103) 
in  the  case  of  the  two-parameter  normal  ogive  submodel,  or  either  (5.3.104)  or  (5.3.105)  in  the  case  of  the 
three-parameter  normal  ogive  submodel;  and  a2{0 *  |  v*)  is  the  variance  of  0*  given  the  generalized  outcome 
vector  v* ,  as  provided  by  either  (5 . 3 . 1 07)  or  (5 . 3 . 1 08)  in  the  case  of  the  two-parameter  normal  ogive  submodel , 
or  either  (5.3. 109)  or  (5.3.1 10)  in  the  case  of  the  three-parameter  normal  ogive  submodel. 

As  indicated  by  the  asterisk  on  the  generalized  outcome  vector  v* ,  the  item  parameters  defined  in  (5.3. 1 12) 
and  (5.3.1 14)  are  those  for  both  the  two-  and  three-parameter  normal  ogive  submodels.  These  respective  param¬ 
eters  are  defined  in  an  identical  manner  under  both  .submodels.  In  the  case  of  the  three-parameter  normal  ogive 
submodel,  the  third  item  parameter  appropriate  for  0*(v2),  the  standardized  form  of  the  variable  of  ability  given 
the  outcome  vector  v*,  is  provided  by 


^3(^2)  =  c*  =  c3,  (5.3.116) 

which  indicates  that  the  lower  asymptote  of  the  characteristic  curve  for  Item  3  remains  undisturbed  by  a  linear 
transformation  of  the  continuous  variable  of  ability. 

For  both  submodels,  the  given  item  parameters  provide  the  property  of  invariance.  The  probability  of  a 

correct  answer  to  Item  3  remains  invariant  for  corresponding  values  of  0,  0*,  and  6>*(v* ).  Under  these  changes 
in  the  scale  of  the  continuous  variable  of  ability,  the  characteristic  curve  remains  invariant. 

At  this  point,  it  is  evident  that  the  process  can  be  extended.  This  extension  of  the  process  consists  of 
choosing  the  third  item  and  of  estimating  ability  and  its  variance  given  the  outcome  on  this  chosen  item.  The 
extension  of  this  process  is  developed  in  Chapter  6  for  a  tailored  test  of  q:  items  where  q,  is  the  subscript  n  on 
the  last  item  in  the  tailored  test  for  individual  /. 


5.4  Mathematical  Proofs 

The  mathematical  formulation  that  is  derived  in  this  section  was  presented  in  Section  5.3.  The  mathematical 
proofs  for  this  formulation  as  developed  in  this  section  may  be  omitted  by  the  reader  who  is  seeking  a  general 
understanding.  The  omission  of  this  section  will  not  result  in  a  loss  of  continuity. 


The  Correlation  Between  Z2  and  0*  Given  the  Outcome  v*,  p(Z2,0  |  O 


In  obtaining  an  explicit  solution  for  p(Z2,0  |  vf),  one  begins  by  deriving  expressions  for  p2(Z,,Z2)  and 
p2(Z,,0)  for  later  substitution  into  (5.3.5).  In  solving  for  p2(Z,,Z2),  an  explicit  solution  for  a(Z2  |  v*)  is  obtained 
from  (5.3.1).  This  solution  yields 


a(Z2  |  v?) 


p(Z|,Z)o'(^)q'(Z[  [  vf) 

P(Z„Z2  |  v*)cr(Z|) 


(5.4.1) 


where  due  to  prior  scaling  <r(Z,)  and  a(Z2)  are  both  unity,  thus  providing 
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*,  pjZ^ZjojZ,  1  vf) 


p(Z,A  IvD  ■ 

After  squaring  (5.4.2)  and  substituting  the  result  into  (5.3.3),  some  rearrangement  provides 


or 


o-2(Z2)[1  —  p2(Z,,Z^)]  =  p2(Z1,Z2)cr2(Z:  |  vf) 


l-p2(Z,,Z2)  =  p2(Z,,Z2)cr2(Z1  I  vf) 


p2(Z|  ,Z2  |  V) ) 


-  1 


1 


P2(Z i I  vi ) 


because  cr2(Z2)  is  unity.  Dividing  both  sides  of  (5.4.4)  by  p2(Z,,Z2),  one  has 

1 


2,7  7,  "I  =  I  vf) 

P  (Z|,Z2) 

where  an  explicit  solution  for  p2(Z,,Z2)  yields 

p2(Z„Z2)  =  j  l+a2(Z,  I  vf) 


P2(2,,Z2  |  vf) 


-1 


(5.4.2) 


(5.4.3) 


(5.4.4) 


(5.4.5) 


P‘(Z,  ,Z2  j  v i ) 

In  solving  for  p2(Z],0),  one  obtains  an  explicit  solution  for  cr(0*  |  vf)  from  (5.3.2).  This  solution  yields 


(5.4.6) 


which  reduces  to 


a(Q*  |  vf) 


cr(6*  |  vf)  = 


p(Zl,0)or(0*)cr(Zl  |  vf) 
p(Z,,0  I  vf)o-(Z,) 

p(Z,,0)o-(O*)o-(Z,  |  vf) 
p(Z,,6  |  vf) 


(5.4.7) 


(5.4.8) 


because  cr(Z,)  is  unity.  After  squaring  (5.4.8)  and  substituting  the  result  into  (5.3.4),  some  rearrangement 
provides 

1 


ct2(  0*)  [  1  —  p2(Z, , 0) ]  =  p2(Z„0)a2(e*)a2(Zl  |  vf)  2 

_  p  \  V\ ) 

where  dividing  both  sides  of  this  equation  by  the  product  o2(0*)p2(Zl ,  0)  yields 

1 


-1 


p2(Z,,0) 


-  1  =  a\Z]  |  vf ) 


1 

P2(Zj,0  |  vf) 


-1 


An  explicit  solution  of  (5.4.10)  for  p2(Z],0)  now  provides 
P2(Z,  ,0)  =  |  1  +cr2(Zj  |  vf) 


p2(Zj,0|  vf) 

After  appropriately  substituting  the  results  of  (5.4.6)  and  (5.4.1 1)  into  (5.3.5),  one  obtains 

p(Z2,0  1  vf)  -  p(Z,,Z2  |  vf )p(Z| , 0  1  vf) 

Vl-p2(Z,,Z2|  vf)  Vl-p2(Z,,0|  vf) 


(5.4.9) 


(5.4.10) 


(5.4.11) 


(5.4.12) 
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where  the  equality  on  the  right  side  can  be  simplified.  By  placing  the  terms  under  the  radicals  on  a  common 
denominator  and  subtracting  terms  in  the  numerator,  one  has 


p(Z2,0)-< 

1  +o-2(Z,  I  vf) 

1 

1 

rs 

1 1  +o-2(Z|  |  vf) 

1 

])-J 

p2(Z,,Z2 1  vf) 

Lp2(Z,,6>|  vf) 

V 

/  cr2(Z,  |  v,  )  v  |  *,  1 

I  [pz(ZltZ2  I  Vj )  J 

i 

t  cr2(Z,  |  v,)  *  -1 

Lp2(Z,,0|vi)  J 

(5.4.13) 

1  +cr2(Z,  |  vf) 

1 

1 

V 

i  +<r2(Z,  |  vf) 

1 

_p2(Z,,Z2  I  vf) 

.p\zue  |  vf)  *J 

Multiplication  of  the  numerator  and  denominator  of  (5.4. 13)  by  the  square  roots  of  the  denominators  under  the 
radicals,  along  with  some  later  rearrangement,  leads  to 


p(Z2,0)\  1  +tr2(Z,  |  vf) 


p2(Z,,Z2  I  v. 


-  1 


1  +ct2(Z,  |  vf) 


1 


P  {Z\,0  I  V, ) 


-  1 


cr2(Z,  |  vf) 


p2(Z,  ,Z2  I  V,') 


p2(Z„9  |  vf; 


(5.4.14) 


where  division  of  the  numerator  and  denominator  by  cr^Z,  |  vf),  along  with  some  later  rearrangement,  yields 


p(Z2, 0)| 

•  ,1 

N 

\  i  i  ,1 

(J-  1 

1  |  Vf) 

o-2(Zi|vf) p2(Z,,Z2  |  vf)  J 

[cr2(z,|vf)  p2(z,,e  | 

1  1 

Vl  )  J 

1 

_p(Z,,Z2  1  vf)_ 

V 

^  1  -  p2(Z,  ,Z2  1  V 

■f) 

1 

_p(Z,,0|  vf)_ 

V 

l-p2(ZuO  1  vf) 

(5.4.15) 


Multiplication  of  the  numerator  and  denominator  in  (5.4.15)  by  p(Z,,Z2  |  vf)  and  p(Z,,0  |  vf),  along  with 
subsequent  rearrangement,  now  leads  to 


p(Z2,0)  l-p2(Z,,Z2|  vf) 


I  - 


o-2(Z,  |  v,  ) 


1  -p2(Z,,0  |  vf) 


1  -- 


0Z,  |  vf)J 


5  _  p(Z,,Z2  |  vf )p(Z, , O  |  vf ) 

<j\zx  I  vf) 


-,  (5.4.16) 


1-P2(Z„Z2|  vf)  ;i-p2(Z,,Z2|  vf) 


which  may  be  substituted  back  into  (5.4. 12)  for  the  expression  on  the  right  side  of  the  equality.  This  substitution 
yields 

p(Z2,0  I  vf)  -  p(Z|,Z,  I  vf)p(Z,,6)  I  vf) 


(5.4.17) 


l-p2(Z,,Z2|  vf)  M-p2(Z,,0|  vf; 


p(Z2,0)\  1  —  p2(Z,,Z2  I  vf) 


o-2(Z|  I  V, ) 


1  -p2(Z,,0  |  vf) 


cr2(Z,  |  vf) 


5  _  P(Z i  ,z2  [  v !  )p(Z[ ,  O  |  V| ) 
o-2(Z,  |  vf) 


-p2(Z:,Z2|  vf)  /  1  -p2(Z,,0  |  vf) 
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where  the  multiplication  of  both  sides  of  this  equation  by  their  common  denominator  yields 
p(Z2,e  |  vf)  -  p(Z,,Z2  |  vf)p(Z,,0  |  vf) 


=  P(Z,0) 


l-p2(Z,,^  I  vf) 


tr2(Z,  |  vf) 


l-p2(Z,,0|  vf) 


1 

a2(Zf  |  v*) 


.5 


p(z„z2  |  vf)p(Z„e|  vf) 

<r2(Z,  I  vf) 

Through  transposing  and  combining  expressions  in  (5.4.18),  one  obtains 


(5.4.18) 


p(Z2,0  |  vf)  =  p(Z2,<9)  f  l-p^.Z,!  vf) 


1- 


cr2(Z,  |  vf) 


1  -p2(Z,,0  |  vf) 


1  - 


1 


+  P(z],z2\vf)p(zl,e\vf) 


i- 


cr2(Z,  |  vf) 


o-2(Z,  |  vf)^ 

(5.4.19) 


which  allows  one  to  proceed  to  a  convenient  expression  for  an  explicit  solution  to  p(Z2,0  |  vf). 

Solving  (5.3.1)  and  (5.3.2)  explicitly  for  p(Z,,Z2  |  vf)  and  p(Z,,0  |  vf),  respectively,  it  is  known  that 


(7  7  \  *\  —  (7  7  \  I  vf) 

P(Z|,Z2  V,  )  —  p(Z1;Z2)  ,'7  \  (7  |  *v 

<r(Z])cr(Z2  |  v, ) 


(5.4.20) 


and 


p(Z,,0  |  vf)  =  p(Z,,0) 


aj 0*)a~(Z|  |  vf) 
o-(Z,)cr(0*  |  vf)’ 


where  cr(Z,)  and  ct(Z2)  are  both  unity.  Thus  one  may  write 


p(Z|,Z2  |  v | ) 


P(Z,  ,z2) 


p~(Z]  I  vf) 
cr(Z2  |  vf) 


(5.4.21) 


(5.4.22) 


and 

p(Z,,0  |  vf)  =  p(Z,,0M0*)  (5.4.23) 

where  squared  and  unsquared  substitutions  from  (5.4.22)  and  (5.4.23)  into  (5.4.19),  along  with  later  rearrange¬ 
ment,  lead  to 


p(Z2,0  |  vf)  =  p(Z2,0) 


/  f,  P2(Z,,Z2) 

VI  ^2|vf) 


o-2(Z,  |  vf)  -  1 


p2(Z|,0)o-2(0*) 
cr2(0*  |  vf) 


a2(Z, 


Vl)- 


p(Z|,Z2)p(Z)  0) o-(0*) 
a(Z2  |  vf)a(0*  |  vf) 


<r2(Z]  |  vf)  -  1 


(5.4.24) 


Given  the  basic  model,  appropriate  substitutions  from  (1.1.21)  into  (5.4.24)  now  provide 
P(Z2,0  |  vf) 


=  p(Z2,0) 


p2(Z,,0)p2(Z2,0) 
f2(Z2  |  vf) 


cr2(Z,  |  vf)  -  1 


p2(Z,,0)a2(0*) 
cr2(0*  |  vf) 


o-2(Z,  |  vf)  -  1 


p2(Zl,0)p(Z2,0)o'(  0*) 
cr(Z2  |  vf)cr(0*  |  vf) 


<r2(Z,  |  vf)-  1 


(5.4.25) 


where  one  will  want  to  substitute  for  cr\Z2  \  vf)  and  <r(Z2  |  vf).  In  solving  (5.3.3)  explicitly  for  cr2(Z2  |  vf), 
one  proceeds  by  transposition  to  obtain 
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a2(Z2  I  vf)  =  a2(Z2)[l  -p2(Z,,Z2)]  +  p2(Zl,Z2  |  vf)a2(Z2  |  vf),  (5.4.26) 

where  cr2(Z2)  is  unity.  Thus,  squaring  (5.4.22)  and  substituting  the  explicit  solution  for  p2(Z,,Z2  |  vf)  into 
(5.4.26)  now  allows  the  writing  of 

^(Z2  I  vf)  =  1  -p2(Z,,Z2)  +  p2(Z,,Z2)cr2(Zl  |  vf);  (5.4.27) 

which  may  be  rewritten  as 

°"2(^2 1  vf)  =  1  +p2(Z,,0)p2(Z2,0)[or2(Z]  |  vf)—  1  ]  (5.4.28) 

because  of  (1.1.21).  Substituting  now  from  (5.4.28)  into  (5.4.25),  one  obtains 
p(Z2,0  |  vf) 


1- 


=  p(Z2,6>) 

p2(Z,,0)p(Z2,0) 


p2(Z^0)p2(Z2,e)[or2(Z1  I  vf)—  1] 


1 +p2(Z,,0)p2(Z2,0)[(T2(Zi  I  vf)  1] 
cr(0*) 


1- 


p2(Z]9G)*2(0*) 

<t2(9*  I  vf) 


[<v2(Z]  I  vf)-  1] 


<r(&*  I  vf) 


[a2(Z,  |  vf)-  1] 


- - —  (5.4.29) 

V  1  +  p2(Zj,0)p2(Z2,0)[<x2(Z,  |  vf )  —  1  ] 

where  placing  the  terms  in  the  first  braces  under  the  first  radical  to  the  right  of  the  equal  sign  over  a  common 
denominator,  subtracting  in  the  numerator,  and  multiplying  the  resulting  expression  by  the  other  expression  in 
braces  under  the  same  radical,  yields 


P(Z2,e|  vf)  =  p(z2,o) 


\-p2(ZuO) 


cr2((9*) 
^(0*  I  vf) 


[o-2(Z,  |  vf )  —  1 1 


1  +p2(Z„e>)p2(Z2,6>)  [cr2(Z|  I  vf)  -  1J 


P2(Z,,0)P(Z2,6>)  [v2(Z,  I  vf)-  1] 


+ 


a(0*  |  vf) 


Vl+p2(Z,,0)p2(Z2,0)  [aHZ,  |  vf)-  1) 


(5.4  30) 


In  (5.4.30)  there  are  four  occurrences  of  the  expression  [cr2(Z,  |  vf)  — 1],  As  a  result,  one  will  want  to  solve 
explicitly  for  this  expression  in  order  to  provide  further  simplification  to  (5.4.30)  through  substitution.  One 
begins  by  rearranging  (5.3.4)  to  obtain 


where  squared  substitution  from  (5.4.23)  into  (5.4.31)  allows  the  writing  of 

a\e*  |  vf)  =  a2(0*)  -  p2(Z,,0)(72(e*)  +  p2(Z,,6>),T2(e*)c72(i 
Some  transposing  of  (5.4.32),  along  with  subsequent  rearrangement,  leads  to 

p2(Z|,0)o-2(0*)[o-2(Z,  |  vf )  —  1  ]  =  ct2(0*  |  vf)-o-2(0*), 
where  division  of  both  sides  of  the  equality  by  p2(Z],6)a2(0 *)  yields 

[er2(Z,  |  vf)— 1]  =  ^~2(^*  1  v*)~°'2(0*) 

'  p2(Z,,6>)a2(e*)  ’ 


*\ 

Vl) 

(5.4.31) 

Vl). 

(5.4.32) 

(5.4.33) 

(5.4.34) 

cr(Q*) 


P(Z2’0)  cr(e*  I  vf)  L  o-2(0*) 


o-2(0*  |  vf) 


1  +p2(Z2,0) 


tr2(Q*  |  vf) 
a2(0*) 


-  1 


(5.4.35) 
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where  the  numerator  under  the  first  radical  on  the  right  side  of  the  equal  sign  in  (5.4.35)  can  be  moved  from 
under  the  radical  after  subtraction  One  then  has 


p{Z2,e\  vf)  = 


p{Z2,0) 


<r(g*) 

a(0*  |  v*) 


<y(0*) 

P(Z2,G)  ^0*  | 


cr2(6>*  |  vf) 
a2(6*) 


-1 


1  +P2(Z2,0) 


<t2(0*  |  vf) 
<r2(0*) 


1 


1+P2(Z2,0) 


O-2(0*  I  vf) 

<t2(0*) 


1 


(5.4.36) 


where  the  denominators  on  the  right  side  of  the  equality  are  identical,  thus  permitting  the  addition  of  the 
numerators.  After  multiplying  through  the  brackets  on  the  second  numerator  on  the  right  side  of  the  equal  sign 
in  (5.4.36),  the  addition  of  the  numerators  yields 


p(Z2,0) 


p(Z2,0  I  vf)  = 


cr(0*  |  vf) 
a(  0*) 


1  +p2(Z2,0) 


o-2(0*  |  vf) 
cr2(0*) 


(5.4.37) 


where  unsquared  and  squared  substitutions  from  (2.3.126)  into  (5.4.37)  allow  one  to  write 

a*  a(0*  |  vf) 


P(Z2,0  |  vf)  = 


\  1  +  [aja(0*)]‘ 


la2*o-(0*  |  vf)]2  -  [a*o-(0*)p 


(5.4.38) 


1  + 


1  +  [afo-(0*)]2 


After  placing  the  expression  under  the  radical  in  the  lower  denominator  of  (5.4.38)  on  a  common  denominator, 
the  subtraction  of  terms  provides 

a* cr(0*  |  vf) 


e&.ei  0  =  ^2335®? 


1  +  [a* cr(0*  |  v 


fP 


(5.4.39) 


y]  l  +  l  at(T{0*)]2 

where  multiplication  of  the  numerator  and  denominator  by  their  common  denominator  yields  the  result 

 a2a(0*  |  vf) 


P(Z2,0  |  vf)  = 


V  1  +  [a* a(0*  |  vf)]2' 


By  definition,  one  has 


p(Z2,0  |  vf)  = 


a2(vt) 


Vl  +  [a2(vf)]: 


(5.4.40) 


(5.4.41) 


where  a2(vf )  is  appropriate  for  0*(vf)  after  its  standardization  to  a  mean  of  zero  and  a  variance  of  unity.  Upon 
squaring  (5.4.41),  one  obtains 


p2(Z2,0  |  vf)  = 


Mvf)]2 


i  +  Mvf)]2’ 

where  the  substitution  of  the  squared  result  of  (5.4.40),  after  transposition,  yields 

[ a2a(0 *  |  vf)]2 


[«2(vf)P 


(5.4.42) 


(5.4.43) 


l  +  [«2(vf)]2  1  +  [a* a(0*  |  vf)]2‘ 

Upon  clearing  the  denominators  in  (5.4.43),  one  has 

Mvf)]2  +  [a2(vf)]2  [aU(0*  |  vf)]2  =  [a*2cr{0*  \  vf)]2  +  [a2(vf)]2  [u2V(0*  |  vf)]2,  (5.4.44) 

where  subtraction  of  the  common  expressions  on  both  sides  of  the  equality  yields 
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(5.4.45) 


la2(vt)]2  =  [a*2*(e*  |  vf)]2- 

Taking  the  square  root  of  (5.4.45)  provides 

a2(vf)  =  a*a(0*  |  vf),  (5.4.46) 

indicating  that  a2(v* ),  appropriate  for  0*(v*)  or  0*(vf)  after  its  standardization  to  a  mean  of  zero  and  variance 
of  unity,  is  obtained  by  the  multiplication  of  two  knowns,  a*  and  er(0*  |  v*).  Thus  (5.4.40)  provides  a  convenient 
expression  for  p(Z2,0  |  vf),  which  was  one  of  the  two  solutions  sought. 


The  Point  of  Dichotomization  on  Standardized  Z2  Given  the  Outcome  v*u  y2(v*) 


The  other  solution  one  now  seeks  is  a  convenient  expression  for  y2(vf ),  the  point  of  dichotomization  on 
Z>(v f),  or,  synonomously,  Z2(vf )  after  its  standardization  to  a  mean  of  zero  and  a  variance  of  unity.  In  obtaining 
this  solution,  one  first  defines  the  rescaling  of  0*  for  which  the  parameter  a2(vf )  is  appropriate.  This  definition 
will  lead  to  a  solution  for  62(vf).  For  completeness,  c2(vf)  will  then  be  defined.  At  this  juncture,  both 
p(Z2,0  |  vf)  and  &2(vf)  will  be  known.  Consequently,  y2(v* )  will  be  known,  because  y2(vf)  is  by  definition 
merely  the  product  of  p(Z2, 0 1  vf )  and  b2(v f ).  After  obtaining  this  solution,  the  important  property  of  invariance 
will  be  evaluated. 

After  incidental  selection  on  0*  due  to  explicit  selection  on  Z, ,  0*  can  be  standardized  to  a  mean  of 
zero  and  a  variance  of  unity.  This  standardization  is  accomplished  in  the  usual  manner  through 


0*(vf) 


fl*-/z(Q*  1  vf) 

a(0*  |  vf) 


(5.4.47) 


where  (9*(vf )  is  the  continuous  variable  of  ability  for  which  the  parameter  a2(vf )  is  appropriate.  The  appropriate 
parameter  b2(v*)  is  obtained  through 


*>2(4) 


bl-tfe*  l  vf) 

<r(0*  |  vf) 


(5.4.48) 


where  the  expression  on  the  right  side  of  the  equality  resembles  the  similarly  positioned  expression  in  (5.4.47). 
This  resemblance  occurs  because,  consistent  with  the  definition  of  the  difficulty  parameter,  b2(vf )  is  rendered 
in  the  standard  scale  of  ability,  in  this  case  that  of  0*(vf).  The  parameters  a2(v f)  and  b2(v f)  are,  as  usual, 
defined  identically  in  both  submodels.  For  the  three-parameter  normal  ogive  submodel,  one  has 

c2(vf)  =  c2  =  c2  (5.4.49) 


again,  as  in  the  case  of  (3.3.65),  because  a  change  in  the  scale  of  ability  leaves  the  lower  asymptote  of  the 
regression  of  a  binary,  multiple-choice  item  on  ability  unchanged. 

Since  y2(vf),  the  point  of  dichotomization  on  Z2(vf),  is  by  definition 

y2(vf)  =  p(Z2,0  |  vf)  ft2(vf),  (5.4.50) 


substitutions  from  (5.4.40)  and  (5.4.48)  into  (5.4.50),  along  with  a  cancellation  of  terms  and  divisions  of  the 
numerator  and  denominator  by  a2 ,  now  yields 


r2(4) 


bZ-fi(0*  |  vf) 

[(a*)~2  +  cr2(0*  |  vf)]  v 


(5.4.51) 


the  solution  that  was  sought.  In  (5.4.51)  one  has  a  convenient  expression  for  the  point  of  dichotomization  on 
Zj(vf)  where  the  required  inputs  are  known. 


The  Property  of  Invariance 

Remember,  the  property  of  invariance  pertains  to  the  probability  of  passing  item  g  This  probability  must 
remain  invariant  for  any  particular  level,  rather  than  numerical  value,  of  the  continuous  variable  of  ability  under 
changes  in  its  scale.  Invariance  is  obtained  by  simple  transformations  of  the  item  parameters  given  a  change  in 
the  scale  of  the  continuous  variable  of  ability.  Earlier,  in  connection  (2.3.122),  the  property  of  invariance  was 
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discussed  in  connection  with  an  arbitrary  prescription  for  the  scale  of  the  continuous  variable  of  ability  In  this 
context,  the  discussion  will  be  extended  to  include  a  change  in  the  scale  of  the  continuous  variable  of  ability 
resulting  from  the  standardization  of  6*  subsequent  to  the  incidental  selection  on  O*  imposed  by  explicit  selection 
on  Z|.  Extending  equation  (2.3.122),  invariance  requires  the  result 

JiiO)  =  y2(0*)  =  y2(0*(vf)],  (5.4.52) 

where  the  second  item  is  potentially  any  one  of  the  remaining  (p-  I)  unused  items  in  the  ability  bank.  The  point 
of  dichotomization  y2[d*  (vf  )|  would  be  the  lower  limit  of  integration  for  the  standardized  conditional  distribution 
of  Z2(v*)  given  0*(vf),  where  the  integral  yields  the  probability  of  either  producing  or  recognizing  a  correct 
answer  to  the  second  item  in  the  tailored  test.  In  this  context,  )]  operates  as  did  y2(0)  in  the  context 

of  (2.1.15).  When  the  level  of  ability  is  arbitrarily  fixed,  y2[0*(vf)]  must  equal  y2(d)  even  though  the  particular 
numerical  values  0*(vq  )  and  d  are  unequal  because  of  intervening  transformations  on  the  scale  of  the  continuous 
variable  of  ability.  The  equality  yields  an  invariant  probability  of  producing  or  recognizing  a  correct  answer  at 
the  arbitrarily  fixed  level  of  ability.  Thus  the  probabilities  yielding  the  item  characteristic  curve  remain  undisturbed 
when  the  equality  in  (5.4.52)  is  maintained.  Given  invariance,  y2[0*(vf)]  is  defined  by 

y2[^(vf)]  =  -a2(vf)  [0*(vf)-02(vf)]  (5.4.53) 

under  the  necessary  condition  of  equality  asserted  in  (5.4.52).  Substitutions  from  (2.  1.15),  (2.3.121),  and  (5.4.53) 
into  (5.4.52)  yield 


-a2(e  -  b2)  =  -a*(0*  -  b$)  =  —  a2(v*)  [0*(vf)  -  b2{v*)},  (5.4.54) 

where  substitutions  from  (5.4.46),  (5.4.47),  and  (5.4.48)  into  the  rightmost  member  of  the  equality  allow  one 
to  write 

-a2(0  -  b2)  =  -a2(0*  -  b$)  =  - a${d *  -  b$).  (5.4.55) 

Subsequent  substitutions  from  (2.3. 1 18),  (2.3. 1 19),  and  (2.3.120)  into  (5.4.55)  provide  proof  of  the  necessary 
condition 


-a2(0  -  b2)  =  - a2(0  -  b2)  =  ~a2(0  -  b2)y  (5.4.56) 

which  demonstrates  the  property  of  invariance  and  the  appropriateness  of  the  parameters  a2(v* )  and  b2(v f)  for 
transformed  ability  (9*(vf). 


Some  Consequences  of  the  Submodels  and  the  Updating  Assumption 


The  Probabilities  for  the  Realizations  of  U*  Given  the  Generalized  Outcome  vf .  In  earlier  developments 
explicit  selection  on  the  continuous  variable  ZH  was  considered  when  ZR  was  in  standard  score  form  and  y  was 
the  “cut  score”  or  point  of  dichotomization  on  ZR.  Here  one  is  considering  explicit  selection  on  the  standardized 
continuous  variable  Z2(v*).  The  standardized  values  of  variable  Z2(vf)  are  defined  by 


£>(vf) 


£;-/z(Z2  |  vf) 
a(Z2  |  vf) 


(5.4.57) 


where  Z2(v*),  like  ZH,  because  of  the  updating  assumption,  is  distributed  bivariate  normally  with  respect  to  the 
continuous  variable  of  ability,  scaled  as  either  O,  O*,  0*(v f),  or  0*(vf). 

Under  the  two-parameter  normal  ogive  submodel  and  the  updating  assumption: 

The  probability  of  a  correct  answer  to  Item  2  given  the  outcome  v,,  Pr(«2  =  1  |  v, ),  is 
designated  as  P2(v{).  This  probability  by  definition  is 

Pr(«2  =  1  |  f,)  =  F2(v,)  =f  f  ^(v,),^,)]  d6*(Vl)  dUvi)  (5.4.58) 

an  equation  which  may  be  viewed  as  resulting  from  the  substitutions  of  y2(v,)  for  y?,  of  £2(v,) 
for  4,  and  of  e*(v,)  for  6  into  (2.3.26).  Since  y2(v,),  l2{vx),  0*(v,),  and,  consequently,  P2(v,) 
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have  respective  definitions  that  correspond  to  those  of  yg,  9,  and  Pg  in  this  earlier  context, 
the  appropriate  substitution  of  y2(v,)  and  &v,)  into  the  earlier  solution  for  Pg,  (2.3.31),  provides 


PrK 


1  |  v,)  =  P2(v,) 


(2 77)- 5  exp{- .5[^2(v,)]2}  ^|2(v,) 


J (277)  5  exp{-.5[£,(v,)]2}  dlg(vx) 


(5.4.59) 


as  the  probability  of  a  correct  answer  given  these  circumstances.  In  (5.4.59),  <P[—  y2(v,)]  is  the 
cumulative  normal  distribution  function  evaluated  for  the  interval  on  Z2(v,)  extending  from  negative 
infinity  to  negative  y2(V)). 


The  probability  of  an  incorrect  answer  to  Item  2,  given  the  outcome  v, ,  Pr(w2  =  0  |  v,), 
is  designated  as  £>2(v,).  This  probability  by  definition  is 


Pr(w2  =  0  |  v,)  =  Q2(v ,)  = 


^(v,),  d'e*(v ,)  dl2(v i), 


(5.4.60) 


an  equation  which  may  be  viewed  as  resulting  from  the  substitutions  of  y2(v,)  for  yg,  of  £2(v,) 
for  iv  and  of  0*(v,)  for  9  into  (2.3.32).  Since  y2(v,),  £>(v,),  0*(v,),  and,  consequently,  G2(v,) 
have  respective  definitions  that  correspond  to  those  of  yg,  £g,  9,  and  Qg  in  this  earlier  context, 

the  appropriate  substitutions  of  y2(v,)  and  £2(v,)  into  the  earlier  solution  for  Qg,  (2.3.35),  provides 
Pr(u2  =  0  |  v,)  =  Gz(Vi)  =  f  '  (27r)“-5  exp{-.5[£2(v,)]2}  dl2(vl)=  <£[y2(v,)] 

(5.4.61) 

as  the  probability  of  an  incorrect  answer  to  Item  2  given  these  circumstances.  In  (5.4.61),  <$[y2(v,)  j 
is  the  cumulative  normal  distribution  function  evaluated  for  the  interval  on  Z2(v,)  extending  from 
negative  infinity  to  y2(v,). 


Under  the  three-parameter  normal  ogive  submodel  and  the  updating  assumption: 

The  probability  of  a  correct  answer  to  Item  2  given  the  outcome  v', ,  Pr(u2  =  1  |  v',),  is 
designated  as  P2(v\).  This  probability  by  definition  is 

Pr(«2  =  1  |  vi)  =  P2(V,) 

=  f  f  <M6(vi),  0*(v',)]  de*(v i)  di2(y\) 

Jy2(»j)  J-* 

+  c2  J_x  ««vi),  0*(rj)]  d9*(v i)  dUv i)  (5.4.62) 

an  equation  which  may  be  viewed  as  resulting  from  the  substitution  of  y2(vj)  for  yg,  of  £2(v',) 
for  Cg,  of  0*(vi)  for  9,  and  of  c2  forcs  into  (3.3.1).  Since  y2(v',),  \2(y\)  0*(V,),  c2,  and,  consequently, 
P'(vj)  have  respective  definitions  that  correspond  to  those  of  yg,  (g,  9,  cg  and  Pg  in  this  earlier 
context,  the  appropriate  substitutions  of  y2(vj),  l2{v\),  and  c2  into  the  earlier  solution  for  Pg, 
(3.3.5),  provides 


Pr («i  =  1  |  vi)  =  P2(v i) 

=  c2  +  (1  -  C2)  f  (2 77)- 5  exp{  —  ,5[£2(vi)]2}  dUv I) 

J-72(v;) 

=  c2  +  (1  -  c2)  j  ^  (2t7)--5  exp{-.5[|2(vi)]2}  dl2(v\) 

=  c2  +  (1  -  c2)  <P[  —  y2(vi)]  (5.4.63) 
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as  the  probability  of  a  correct  answer  given  these  circumstances.  In  (5.4.63),  cf>[  —  -y2(vi )]  is  the 
cumulative  normal  distribution  function  evaluated  for  the  interval  on  Zj(vJ)  extending  from  negative 
infinity  to  negative  •y2(vi )- 

The  probability  of  an  incorrect  answer  to  Item  2  given  the  outcome  vj,  Pr (u2  =  0  |  vj ), 
is  designated  as  Q2(v\).  This  probability  by  definition  is 

Pr(M2  =  0  |  vj)  =  Q'2(v\)  =  (1  -  c2)J_x  J  *  4>[£2(v\),e*(v\)]  d6*(v j)  </|2(v j)  (5.4.64) 

an  equation  which  may  be  viewed  as  resulting  from  the  substitutions  of  y2(vj)  for  yg,  of  £2(v|) 
for  £g,  of  0*(vj)  for  0,  and  of  c2  for  cg  into  (3.3.6).  Since  y2(vj),  |2(vj),  0*(vj),  c2,  and, 
consequently,  Q2(v j)  have  respective  definitions  that  correspond  to  those  of  yg,  £g,  6,  cg,  and 
Q'g  in  this  earlier  context,  the  appropriate  substitutions  of  y2(vj),  f2(vj),  and  c2  into  the  earlier 
solution  for  Q'g,  (3.3.8),  provides 

Pr(«2  =  0  |  vj)  =  Q'2{v j) 

=  (1  -  cz)  J_x  (2 IT)  5  exp{-.5[£,(vj)]2}  dl2(v\) 

"  0  -  c2)  <?[y2(vj)]  (5.4.65) 

as  the  probability  of  an  incorrect  answer  to  Item  2  given  these  circumstances.  In  (5.4.65), 
3>[y2(»fi)]  is  the  cumulative  normal  distribution  function  evaluated  for  the  interval  of  j^(yj) 
extending  from  negative  infinity  to  y2(vj). 

The  Means  of  Z2  (vf)  and  Z  (v*)for  the  Realizations  ofU*.  At  this  juncture,  the  Z2(v*)  are  standardized 
variables  which,  by  assumption,  and  like  Zg  in  a  previous  setting,  are  distributed  bivariate  normally  with  respect 
to  the  continuous  variable  of  ability.  The  previous  developments  obtained  under  identical  circumstances  can  thus 
be  interpreted  into  the  present  context  to  provide  the  solutions  for  the  means  of  the  j^(vf).  In  order  to  obtain 

the  solutions  for  the  means  of  the  continuous  variables  Z2(vf)  whose  mean  deviate  values,  £2(vf),  are  defined 
by 

&(vf)  =  C2-M(^2  I  vf),  (5.4.66) 

some  further  development  is  required. 

Given  the  two-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 
v.: 


The  mean  of  Z2(v,)  when  a  correct  answer  to  Item  2  is  observed,  fjb(Z2  \  v]yu2  =  1),  is 
by  definition 

I  =  0  =  <§(Z2  |  VUU2  =  1) 


-f  S' 

J  y2(v,)  J- 


6(V|)  ^*[^(V|)>(v,)]  dd*(vt)  dl2(vx)  (5.4.67) 


where,  in  this  context,  the  joint  density  function  <£*[£2(v,),  0*(v,)]  is  given  by 


0*^)1 

Pl{VX) 


(5.4.68) 


Equations  (5.4.67)  and  (5.4.68)  may  be  viewed  as  resulting  from  equations  (2.3.36)  and  (2.3.37) 
after  substitutions  of  y2(v,)  for  yg,  £,(v,)  for  (g,  0*(v,)  for  0,  and  P2(v,)  for  Pg.  Since  y2(v,), 
^>2  ( v  i ) »  0*(v,),P  2(v,),  and,  consequently,  ^,(Z2|v,,m2  =  1)  have  respective  definitions  that  correspond 
to  those  of  yg,  £g,  0,  Pgt  and  n-(Zg  |  ug  =  1)  in  this  earlier  context,  one  can  then  interpret  the 
earlier  solution  for  fx.(Zg  |  ug  =  1),  (2.3.48),  into  the  present  context  as 


p(Z2 1  v,,«2  =  I)  = 


</>[y2(vi)] 

P2(vO 


(5.4.69) 
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which  provides  the  mean  of  Z2(vx)  when  a  correct  answer  to  a  free-response  Item  2  is  observed. 
Notice  that  (5.4.67)  may  be  rewritten  as 

^(^2  I  vl>w2  =  0  “  7 7  I  \  I  VI>W2  =  0 

cr(Z2  I  v,) 

*  L,,  L  «”'>  (5.4.70) 

because  of  (5.4.57)  and  (5.4.66).  In  the  equality  involving  a  double  integral  in  (5.4.70),  a  constant 
with  respect  to  the  integration,  the  reciprocal  of  cr(Z2  |  Vj),  has  been  moved  outside  of  this  in¬ 
tegral.  This  operation  renders  the  expected  value  obtained  through  integration  from  that  of 
/x(Z2  |  vl5w2  =  1)  in  (5.4.67)  to  that  of  p{Z2  \  vx,u2  =  1)  in  (5.4.70).  Because  of  (5.4.69)  and 
(5.4.70),  one  may  then  write 


/i(Z2  I  vuu2  =  1)  =  o-CZj  I  v,)^(Z2  I  V|  ,u2  =  1)  =  a(Z2  |  v,)  —  (5.4.71) 

" 2v^l / 

as  the  mean  of  Z2(vx)  when  a  correct  answer  to  Item  2  is  observed.  But  from  (5.4.66)  and  (5.4.70) 
it  is  known  that 

/tx(Z2  I  vuu2  =  1)  =  %(Z2\  V]  ,u2  =  1) 


roc 

[£2-lx(Z2\vO]<t>*[l2('’\)Mvi)]dd*(vl)d(2(vi)  (5.4.72) 

)  J  —x 

which  involves  obtaining  the  expected  value  of  a  continuous  variable  in  mean  deviate  form. 
Equation  (5.4.72)  may  also  be  written  as 

/a(Z2  |  vuu2  =  1) 

roc  roc 

£2$*lUvi)Mvx)]  d6*{vx)  dl2{v{) 

Jy2{vx)  J  c 

-  f  f  p(Z2  I  V,)  4>*li2{vi)Mvi)]  de*(vx)  dUvx)  (5.4.73) 

J  y2(Vj)  J  -* 

an  equation  involving  a  difference  between  double  integrals.  In  (5.4.73)  the  double  integral  where 
the  integrand  is  a  product  of  f2  is  by  definition  %{Z2  \  vx,u2  =  1)  or  /jl(Z2  \  vx,u2  —  1).  Thus, 
one  may  write 

lx(Z2  |  v,,m2  =  1)  =  fi(Z2  |  v,,u2  =  1) 

-li(Z2  |  v,)  [ 

Jyp\> 

where  the  constant  with  respect  to  the  integration,  fji(Z2  \  v{),  has  been  written  outside  of  the 
double  integral.  After  a  substitution  from  (5.4.68)  into  (5.4.74),  one  has 

pt(Z2  |  Vj ,w2  =  1)  =  (i{Z2  |  vx,u2  =  1) 

-  M52J  f  [  «&(F|)>(v,)]  de*(Vl)  42(v,)  (5.4.75) 

P 2(V|)  Jy2(v,)  J  -=c 


(5.4.74) 

{  x  riUvoMvO]  de*(vo  ^2(v,) 


or  merely 

^i(Z2  I  =  1)  =  /i(Z2  I  v,,m2  =  1)  -  m(Z2  I  v,)  (5.4.76) 

because  of  (5.4.58).  In  (5.4.76),  ix{Z2  |  V!,w2  =  1)  is  the  mean  of  the  continuous  variable  Z2  as 
originally  scaled  subsequent  to  the  effects  of  incidental  selection  resulting  from  explicit  selection 
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on  the  continuous  variable  Z,  and  of  explicit  selection  on  the  continuous  variable  Z2  given  the 
earlier  incidental  selection;  and  p(Z2  |  v,)  is  the  mean  of  the  continuous  variable  Z2  given  the 
incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Z, . 

The  mean  of  Z2(v,)  when  an  incorrect  answer  to  Item  2  is  observed,  p(Z2  |  vuu2  =  0), 
is  by  definition 

p(Z2  |  v, , w2  =  0)  =  %(Z2  |  V|  ,u2  =  0) 

fW  . 

=  J_X  )_X  «*,)  4>U(v,)>(v,)]  dd*(Vl)  d£2(Vl),  (5.4.77) 

where,  in  this  context,  the  joint  density  function,  <^>+[ ^2(vi )>  0*(v,)],  is  given  by 


*tl&(v,)>(p,)] 


0[f2(Vl),g*(V|)3 

Q2(v<) 


(5.4.78) 


Equations  (5.4.77)  and  (5.4.78)  may  be  viewed  as  resulting  from  equations  (2.3.49)  and  (2.3.50) 
after  substitutions  of  y2(v,)  for  yg,  £2(v,)  for  £g,  0*(v,)  for  6,  and  Q2(vt)  for  Qg.  Since  y2(v,), 
9*(vi),  Q2(v ,),  and,  consequently,  p(Z2  \  vuu2  =  0)  have  respective  definitions  that 
correspond  to  those  of  yg,  (g,  6,  Qg,  and  p{Zg  |  ug  =  0)  in  this  earlier  context,  one  can  then 
interpret  the  earlier  solution  for  p(Zg  \  ug  =  0),  (2.3.59),  into  the  present  context  as 


d(Z2  |  V|,«2  =  0) 


0[T2(Vl)] 

Q2(v  .) 


(5.4.79) 


which  provides  the  mean  of  Z2(v,)  when  an  incorrect  answer  to  free-response  Item  2  is  observed. 
Notice  that  (5.4.77)  may  be  rewritten  as 

/x(Z2 1  v,  ,u2  =  0)  =  -  1 — -  p  (Z2  |  V|,m2  =  0) 

°r(Z2  |  v,) 

=  ^  7 1 1  „  1  %  (Z2  I  V|’“2  =  0) 

a(Z2  |  v,) 

1  p¥V  fx  . 

=  0'(Z2  |  y  )  J-x  J_K  ^(v'}  ^+t&(V|)>(P|)l  rf»*(V|)  (5.4.80) 

because  of  (5.4.57)  and  (5A66).  This  operation  renders  the  expected  value  obtained  through 
integration  from  that  of  p(Z2  |  v,,u2  =  0)  in  (5.4.77)  to  that  of  / u(Z2  |  v,,u2  =  0)  in  (5.4.80). 
Because  of  (5.4.79)  and  (5.4.80),  one  may  write 

p(Z2  |  v,,«2  =  0)  =  cr(Z2  |  v,)p(Z2  |  v,,u2  =  0)  =  -cr(Z2  |  v,)  (5.4. 81) 

Q2(v  i) 

as  the  mean  of  Z2(vl)  when  an  incorrect  answer  to  Item  2  is  observed.  But  from  (5.4.66)  and 
(5.4.80)  it  is  known  that 

piA  I  V|,k2  =  0)  =  % (Z2  I  v,,w2  =  0) 


[^-MZ2  I  V,)]  tfC&vjMvO]  d0*{vx)  dUv{), 


(5.4.82) 


which  involves  obtaining  the  expected  value  of  a  continous  variable  in  mean  deviate  form.  Equation 
(5.4.82)  may  also  be  written  as 


/x(Z2  |  Vj,w2  =  0) 


£  <A+[&(V.)>(Pl)]  rf0*(Vl)  42(V|) 


roc 

-  J_x  J  ^  ^(^2  I  vi)  ^[^2(^1), 0*(v,)]  dfl*(v,)  </£2(v,),  (5.4.83) 
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an  equation  involving  a  difference  between  double  integrals  In  (5.4.83),  the  double  integral  where 
the  integrand  is  a  product  of  £2  is  by  definition  %{Z2  \  vuu2  =  0),  or  ji(Z2  \  vuu2  =  0).  Thus, 
one  may  write 

fx(Z2  |  vuu2  =  0)  =  /x(Z2  |  v,,w2  =  0) 


~P(Z2  I  V,)  J_'x  J_5c^t[&(vI)>(vI)]</fl*(v,)42(Vi),  (5.4.84) 

where  the  constant  with  respect  to  the  integration,  /r(Z2  |  v,),  has  been  written  outside  of  the 
double  integral.  After  a  substitution  from  (5.4.78)  into  (5.4.84),  one  has 

tx(Z2  |  v,,m2  =  0)  =  n(Z2  |  V|,«2  =  0) 

n(z2 1  v,)  . 

-  '  '  «6(Fi),0*(fi)]  </0*(f,)  </£2(v,),  (5.4.85) 

Q2\V\ )  ** _3C  _cc 


or  merely 

^t(Z2  |  v,,w2  =  0)  =  \x(Z2  |  v,,m2  =  0)  -  ju(Z2  |  v,),  (5.4.86) 

because  of  (5.4.60).  In  (5.4.86),  /x(Z2  |  Vj,w2  =  0)  is  the  mean  of  the  continuous  variable  Z^  as 
originally  scaled  subsequent  to  the  effects  of  incidental  selection  resulting  from  explicit  selection 
on  the  continuous  variable  Z,  and  of  explicit  selection  on  the  continuous  variable  Z2  given  the 
earlier  incidental  selection;  and  \x(Z2  |  v,)  is  the  mean  of  the  continuous  variable  Z2  given  the 
incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Zx . 

Given  the  three-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 


The  mean  of  Z2(v,)  when  a  correct  answer  to  Item  2  is  observed,  p,(Z2  |  v', ,  u2  =  1),  is 
by  definition 


/x(Z2  |  vj,«2  =  1)  =  %{Z2  |  v\,u2  =  1) 

roc  roc 

Uv\)  <t>*'[£2(v\)Mv\)]  de*(v\)  dUv\) 

^  y2<v|>  J  X 

+  c2  L:  &<vi>  ^*'t&(vi)>(vi)l  de*(v i)  dUv i),  (5.4.87) 


where  the  joint  density  function  <£*'[£2(vi).0*(vi)]  is  given  by 


4wvj )] 


(5.4.88) 


Equations  (5.4.87)  and  (5.4.88)  may  be  viewed  as  resulting  from  equations  (3.3.11)  and  (3.3.12) 
after  substitutions  of  y2(vj)  for  7*.  h(v\)  f°r  £g,  0*(vj)  for  6,  P'2(vf)  for  P'g,  and  c2  for  cg.  Since 
y2(vi),  0*(v',),  P'2(v\ ),  c2,  and,  consequently,  /r(Z2 1  vj ,u2  =  1)  have  respective  definitions 

that  correspond  to  those  of  yg,  0,  P'g,  cs,  and  /x( Z 'g  |  u'g  =  1)  in  this  earlier  context,  one  can 
then  interpret  the  earlier  solution  for  /x (Zg  \  u'K  =  1),  (3.3.21),  into  the  present  context  as 

i  ,  .  1X  ,,  ,  <i>[y i(vi)] 

M(Z2  v,,m2  =  1)  =  (1  -  c2)-——-,  (5.4.89) 

Pi(v  i) 


which  provides  the  mean  of  Z2(vJ)  when  a  correct  answer  to  a  multiple-choice  Item  2  is  observed. 
Notice  that  (5.4.87)  may  be  written  as 
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/l(Z2  I  V\,U2  =  1)  = 


-  /j.(Z2  I  v\,u2  =  1)  = 


a(Z2  |  vi) 

v-{r  f 

>  vi)  l  •'?2(ri>  ^  ' 


—  %{Z2  |  V  j ,  W 2  =  1) 


a(Z7 


<r(Z2  |  vi) 

&(vi)  4>*'l£2(v\)Mv\)]  </0*(vi)  42(vi) 


+ 


&(vi)  0*#[&(v;)>(vi)]  rf9*(vi)  42(vi) 


(5.4.90) 


because  of  (5.4.57)  and  (5.4.66).  In  the  equality  involving  the  two  double  integrals  in  (5.4.90), 
a  constant  with  respect  to  the  integration,  the  reciprocal  of  a(Z2  |  vj),  has  been  moved  outside 
of  these  double  integrals.  This  operation  renders  the  expected  value  obtained  through  the  composite 
of  double  integrals  from  that  of  fx{Z2  \  v\,u2  =  1)  in  (5.4  87)  to  that  of  f±(Z2  \  vj  ,«2  —  1)  in 
(5.4.90).  Because  of  (5.4.89)  and  (5.4.90)  one  may  then  write 

M(Z2  I  v\  ,u2  =  1)  =  a(Z2  I  vi )ti{Z2  I  vi  ,u2  =  1)  =  <r(Z2  |  vj)(l  -  c2)  (5.4.91) 

^  2(VW 


as  the  mean  of  Z2(vi)  when  a  correct  answer  to  Item  2  is  observed.  But  from  (5.4.66)  and  (5.4.90), 
it  is  known  that 

/x(Z2  I  Vj,W2  =  1)  =  %{Z2  |  V],W2  =  1) 


[& -MZz  I  vi)]  i)l  dd*(v i)  dUv i) 


+ 


l(2-fJi(Z2  I  vi)]  4>*'[&(vi)>(vi)]  d'e*{v i)  dl2(v\). 


(5.4.92) 

which  involves  the  taking  of  an  expected  value  of  a  continuous  variable  in  mean  deviate  form. 
Equation  (5.4.92)  may  also  be  written  as 

MZz  I  vi,«2  =  i) 

=  f  f  C2<P*'[l2WMv\))de*{v\)dl2(v\) 

Jr,o.j)  J-x 

-I"  f  M-Zzl  vj)  <f>*'[£2WMv*)]d~d*(v\)dZ2(v\) 

A2<vj)  ^  x 

+  cg  [^  \_x  h  <i>*'lt2(v\)Mv\))  de*(v i)  dl2{v i) 

-  cg  /;:7  x  ix(Z2 1  vi)  <t>*'['t2{v\),  0*(vi)]  de*(v\)  d£2(v\),  (5.4.93) 

an  equation  involving  four  double  integrals.  In  (5.4.93),  the  sum  of  the  two  double  integrals  where 
the  integrand  is  a  product  of  £2  is  by  definition  %(Z2  |  v',,w2  —  1)  or  fi(Z2  |  v\,u\  —  1).  Thus, 
one  may  write 

jx{Z2  |  vi,w2  =  1)  =  \x(Z2  |  v I ,  w2  =  1) 

-M(^|vl)|  I  4>*'[Uv\)Mvmd0*(v\)dl2(y\) 

Jy2iv'0  J 

-c2/*(Z^  |  v,)  f  ^  f  x  </>*'U2(v',),0*(vi)]  dff*(v i)  d(2(v i),  (5.4.94) 

where  the  constant  with  respect  to  the  integration,  fx{Z2  |  vj),  has  been  written  outside  of  the 
double  integrals.  After  a  substitution  from  (5.4.88)  into  (5.4.94),  one  has,  after  some  rearrange¬ 
ment, 
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(5.4.95) 


/x(Z2  |  v\,u'2  =  1) 

I  v,)  f  r  r  - 

=  p  ,v  '  I  0[&(vi),^W)]  rf®*(vi)  rf&(vi) 

+  C2  «6W).  42(vj)  j, 

which  may  be  written  as 

M(Zz  |  vj ,«2  =  1)  =  p(Z2  |  vj,K2  =  l)  —  fi(Z2  |  vl),  (5.4.96) 

after  a  substitution  from  (5.4.62)  for  the  expression  within  the  braces  in  (5.4.95).  In  (5.4.96), 
p(Z2  |  v j , ir 2  =  1)  is  the  mean  of  the  continuous  variable  ^  as  originally  scaled  subsequent  to 
the  effects  of  incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Z, 
and  of  explicit  selection  on  the  continuous  variable  Z2  given  the  earlier  incidental  selection;  and 
P(Z2  |  vj)  is  the  mean  of  Z2  given  the  incidental  selection  resulting  from  explicit  selection  on  the 
continuous  variable  Z,. 


The  mean  of  Zj(vj)  when  an  incorrect  answer  to  Item  2  is  observed,  plZj  |  vj,«2  =  0), 
is  by  definition 

/u(Z2  |  vj,«2  =  0)  =  %{Z2  |  vj,«2  =  0) 


=  (1  -  c2) 


U*\)  tf'lUvd'OHv'i)]  de*(v j)  dUv j). 


(5.4.97) 


where,  in  this  context,  the  joint  density  function,  <£+'[£2(vj), 0*(vj)],  is  given  by 


fit#  ;)>(vi)j 


0[^2(vj  ),fl*(vj)] 

Qi(y ',) 


(5.4.98) 


Equations  (5.4.97)  and  (5.4.98)  may  be  viewed  as  resulting  from  equations  (3.3.22)  and  (3.3.23) 
after  substitutions  of  y2(vj)  for  yg,  &(vj)  for  £g,  6*(v j)  for  6,  Q2(y j)  for  Qg,  and  c2  for  cg.  Since 
■frO’j),  i),  0*(vj),  Gi(vj),  C2(vj),  c2,  and,  consequently,  ^(Z,  |  vj,w2  =  0)  have  respective 
definitions  that  correspond  to  those  of  yg,  £g,  6,  Qg,  Qg,  cg,  and  n(Zg  \  u'2  =  0)  in  this  earlier 
context,  one  can  then  interpret  the  earlier  solution  for  fi(Zg  \  u'g  =  0),  (3.3.31),  into  the  present 
context  as 


M(Z2  |  vj,u2  =  0) 


Qi(y i)  ’ 


(5.4.99) 


which  provides  the  mean  of  Z2(vj)  when  an  incorrect  answer  to  a  multiple-choice  Item  2  is 
observed. 

Notice  that  (5.4.97)  may  be  written  as 
fJL(Z2  |  v\ ,u'2  —  0) 


=  ~ZT' 7  1  I  Vi-«2  =  0) 

cr(Z2  |  V,) 

=  / 7  |  77  ^(Z2  |  V|,K2  =  0) 

Cr(Z2  |  V,) 

(i  -  c2)  fT-’i’  r  ■  t  - 

=  ^  |  ~j  J_x  J_x  ^Vi)  <f>"li2(.y\),e*(v\)]  de*(v\)d£2(v\)  (5.4.100) 

because  of  (5.4.57)  and  (5.4.66).  In  the  equality  involving  the  double  integral,  a  constant  with 
respect  to  the  integration,  the  reciprocal  of  cr(Z2 1  vj),  has  been  moved  outside  the  double  integral. 
This  operation  renders  the  expected  value  obtained  as  the  product  of  (1  -  c2)  and  the  double 
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integral  from  that  of  p(Z2  \  vj,w2  =  0)  in  (5.4  97)  to  that  of  p(Z2  \  v',,w2  =  0)  in  (5.4.100). 
Because  of  (5.4.99)  and  (5.4.100),  one  may  then  write 

lx(Z2  |  v\,u'2  =  0)  =  a(Z2 1  v\)fi(Z2  |  vj ,u2  =  0)  =  —  cr(Z2  |  v',)  (5.4.101) 


as  the  mean  of  Z2{v\)  when  an  incorrect  answer  to  Item  2  is  observed.  But  from  (5.4.66)  and 
(5.4. 100)  it  is  known  that 

/x(Z2  |  v i , u2  =  0)  =  %{Z2  |  v\,u2  =  0) 

=  (|  -  C2)  1 j  x  [C2-^{Z2  I  Vi)]  <f>f'[Uv\)Mv\)]  de*(v i)  dl2(v i), 


(5.4.102) 

which  involves  obtaining  an  expected  value  of  a  continuous  variable  in  mean  deviate  form.  Equation 
(5.4.102)  may  also  be  written  as 

/x(Z  |  vj  ,w2  —  0) 


=  (i  -  c2) 


n: 


(1  -  C2) 


n 


ii  P'lUvdMvi)  ]de*(v\)  dUv\) 

X 

V(Z2 1  vi)  )>(vi)]  d0*(v i)  dl2(y\), 

—  x 


(5.4.103) 


an  equation  involving  the  difference  between  the  products  of  a  constant,  (1  —  c2),  and  a  double 
integral.  In  (5.4. 103),  the  product  of  this  constant  and  the  double  integral  where  the  integrand  is 
a  product  of  £2  is  by  definition  %(Zi  \  v\,u'2  =  0)  or  /x(Z2  |  vj,w2  =  0).  Thus  one  may  write 

IJ.(Z2  |  v i , w 2  =  0)  =  M(Z2  |  v\,u2  =  0) 

<t>rlL(v\)Mv i)]  d6*(v i)  dUv i),  (5.4.104) 

where  the  constant  with  respect  to  the  integration  fx(Z2  \  vi),  has  been  written  outside  of  the  double 
integral.  After  a  substitution  from  (5.4.98)  into  (5.4.104),  one  has 

M(Z>  I  v\,u2  =  0)  =  n(Z2  |  v j ,u2  =  0) 

I  vi)  ~~ry^  (_['  f  x  0[^(v,),e*(vi)]  rf0*(vi)  42(vi)  (5.4.105) 


-  fi(Z2  |  v',)  (1  -  c2) 


or  merely 

fx(Z2  I  v;,w2  =  0)  =  fJi(Z2  I  vi,M2  =  0)“^(^2  I  (5.4. 106) 

because  of  (5.4.64).  In  (5.4.106),  /x(Z2  \  vj  ,w2  =  0)  is  the  mean  of  the  continuous  variable  Z2 
as  originally  scaled  subsequent  to  the  effects  of  incidental  selection  resulting  from  explicit  selection 
on  the  continuous  variable  Zj  and  of  explicit  selection  on  the  continuous  variable  Z2  given  the 
earlier  incidental  selection;  and  /x(Z2  |  v',)  is  the  mean  of  the  continuous  variable  Z2  given  the 
incidental  selection  resulting  from  explicit  selection  on  the  continuous  variable  Zh 

A  generalized  expression  may  now  be  written  for  p (Z2  |  v\,U2).  As  can  be  seen  in  (5.4.76),  (5.4.86), 
(5.4.96),  and  (5.4.106),  this  expression  is  given  by 

MZ2  I  v? ,U$)  =  ^{Z2  I  vf  ,l]*2)-ix{Z2  I  vf),  (5.4.107) 

a  form  that  proved  useful  in  an  earlier  context.  In  this  earlier  context,  ability  estimation  was  compared  to  a  more 
familiar  method  of  estimation.  This  method  was  that  of  linear  regression. 

The  Variances  of  Z2(vf)  for  the  Realizations  of  U*.  By  assumption  it  is  known  that  the  standardized 
continuous  variables  Z2(vf),  like  ZR  in  an  earlier  setting,  are  distributed  bivariate  normally  with  respect  to  the 
continuous  variable  of  ability.  Thus,  the  earlier  developments  obtained  under  identical  circumstances  can  be 
interpreted  into  the  present  context  to  provide  solutions  for  the  variances  of  the  Z2(vf )  for  each  of  the  realizations 
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of  U*.  However,  some  further  developments  are  required.  These  developments  demonstrate  that  the  variances 
of  Z2(v, )  for  each  of  the  realizations  of  U*  possess  identities  that  consist  of  the  ratios  of  variances.  These  ratios 
of  variances  are  required  in  the  derivations  which  provide  solutions  for  the  variances  of  ability  given  the  outcomes 
v*  and  U2. 

Given  the  two-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 

The  variance  of  Z2(v\)  when  a  correct  answer  to  free-response  Item  2  is  observed, 
o2{Z2  |  vl9  u2  =  1),  is  by  definition 


cr(Z2  |  v,,  u2  =  1)  =  %(Z\  |  v,,m2  =  1)  ~  /x2(Z2  |  v,,w2  =  1) 


-r  f 

Jyiiv i)  J  -* 


[^2(v,)]2  <£*[6(v.),0*(v1)]  cie*(v,)  d£2{V\) 


F  I 


^(Vi)  <f>*[C2(v i),  0*(v,)]  d8*(vt)  r/£2(v,)  [  ,  (5.4.108) 


where  the  joint  density  function  <£*[&( vt),  0*(v,)]  is  provided  by  (5.4.68).  Equations  (5.4.68) 
and  (5.4.108)  may  be  viewed  as  resulting  from  (2.3.36),  (2.3.37),  and  (2.3.62)  after  substitutions 
of  y2(v,)  for  yg,  £(v,)  for  0*(v,)  for  0,  and  P2(v,)  for  Pg.  Since  y2(v,),  &(v,),  0*(v,), 
P 2(v,),  and,  consequently,  a2(Z1  \  v,,«2  =  1)  have  respective  definitions  that  correspond  to  those 
°f  Jtr  Cg,  6,  Pg,  and  cp-{Zg,Ug  =  1)  in  this  earlier  context,  one  can  then  interpret  the  earlier 
solution  for  cr2^  |  ug  =  1),  (2.3  82),  into  the  present  context  as 


o-2(Z2  |  v,  ,u2  =  1)  =  1 


^>[72(*,i)]  f  ^>[y2(t,i)] 
P2(v,)  1  P2(V.) 


(5.4.109) 


which  provides  the  variance  of  Z2(v,)  when  a  correct  answer  to  a  free-response  Item  2  is  observed. 

Because  of  (5.4.57),  (5 .’4.66),  and  (5.4.70),  an  abbreviated  form  of  (5.4.108)  may  be 
written  as 

a2(Z2  |  v,,w2  =  1)  =  [% (Z|  |  v,,«2  =  1)  -  /x2(Z2  |  v,,«2  =  1)],  (5.4.110) 

(7  iZi2  |  V\) 

where  the  expression  in  brackets  is  a  variance.  This  expression  by  definition  is  the  variance  of 
Z2(V|)  when  a  correct  answer  to  Item  2  is  observed.  The  equation  for  this  variance  then  is 

o-2(Z2  |  v,,  m2  =  1)  =  %{Z\  |  v, ,u2  =  1)  -  /x2(Z2  |  v,,«2  =  1).  (5.4.111) 

A  substitution  from  (5.4.111)  into  (5.4.110)  allows  one  to  write 

ct2(Z2  |  v,  ,u2  =  1) 

cr\Z2  |  v,,«2  =  1)  =  - r— — - ,  (5.4.112) 

v  (Z2  |  v,) 

where  a2(Z2 1  v,,w2  =  1)  has  an  identity  which  after  substitution  into  (5.4.1 12)  provides  a  more 
useful  expression. 

In  solving  for  this  identity,  it  is  necessary  to  examine  further  the  expected  value 
%(Z2  |  V|,«2  =  1).  Because  of  (5.4.66),  this  expected  value  of  squared  mean  deviates  may  be 
expanded  as 

%(Z?2 1  V,,«2  =1)=|  J  [£(v,)]2  </>*[£2(v,),  0*(v,)]  ddHv,)  d£2(vt) 

=  I  ,  J  IC2~  P-(Z2  |  v,)]2  4>*[£(v,),  0*(v,)]  dd*(V])  d£2(vt) 

=  f  ,  J  Cl  Vltivx),  0*(r,)l  de*(v,)  d£2(v,) 

Jyiiv i)  J  -* 

-  2fi(Z2  I  V,)  |  f  (2  4>*ll 2(v,),  0*(v,)]  de*(v,)  d£2(vt) 

Jy2(v i)  J  -x 

+  IX2(Z2  I  v,)  [  I  0*(v,)]  </0*(v.)  dl2(Vx),  (5.4.113) 
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where  the  constant,  yu,(Z2  |  v,)  or  /m2(Z2  |  v,),  has  been  moved  outside  of  two  of  the  double 
integrals.  In  the  last  equality  in  (5.4.113),  the  first  double  integral  defines  %{Z\  \  vi,u2  =  1), 
where  one  then  has 


%(Z}  |  v, ,w2  =  1)  =  [  f  Ci  <*>*[£2(V|),  0*(v,)]  de*(vt)  dl2(v{) 
J  yi(  »’|)  J  -* 

and  the  second  double  integral  defines  fx(Z2  |  v,,w2  =  1),  where  one  has 


M-Zz  |  V|,«2  =  1)  =  [  [ 

J  -y2<  vi  >  J 


Ci  4>*(£>(v,),  ^(v,)]  </0*(v,)</£2(v,). 


Substituting  from  (5.4.68),  (5.4. 1 14),  and  (5.4. 1 15)  into  (5.4. 113),  one  may  write 
%{Z\  |  v,,«2  =  1)  =  %{Z\  |  v„w2  =  1) 

-  2 ix(Z2  |  v,)  fx(Z2 1  v |  ,u2  =  1) 


(5.4.114) 


(5.4.115) 


+  f  (5.4.116) 

P2(v,)  Jytfi’i)  J  -* 


where  this  equation  may  be  simplified  to 

%(Zl\vuu2  =  1)  =  %{Z\\vx,u2  =  1) 

-  2 n(Z2 1  V|)  /U .(Z2  I  v,,w2  =  1)  +  h2(Z2  I  V|)  (5.4.117) 

because  of  (5.4.58).  A  substitution  from  (5.4.1 17)  into  (5.4.1 1 1)  now  provides 

ct2(Z2  |  v, ,«2  =  1)  =  %{Z\  |  V|,«2  =  1) 

-  2 n(Z2  \  v | )  /x(Z2  |  v,,w2  =  1) 

+  /a.2(Z2 1  v,)  -  /x2(Z2  |  V|,n2  =  1)  (5.4.118) 

where  a  further  substitution  from  the  squared  result  of  (5.4.76)  yields 
o-2(Z2|  v„«2  =  1)  =  ?o(Z22|  v„«2  =  1) 

-  2[x(Z2  |  v,)  /u,(Z2  |  v,,u2  =  1) 

+  /x2(Z2  |  v,)  -  h2(Z2  |  v,,«2  =  1) 

+  2/li(Z2  |  v,)  ^(Z2  |  v | ,n2  =  1)  -  m2(^2  |  v,).  (5.4.119) 


The  cancellation  of  terms  in  (5.4.119)  provides 

£7-2(Z2  |  V,,W2  =  1)  =  %{Z\  |  V,,W2  =  1)  -  fl2(Z2  |  V,,W2  =  1). 
But,  by  definition,  one  has 

a2(Z2  |  v j ,w2  =  1)  =  %(Z\  |  v,,n2  =  I)  -  /x2(Z2  |  v,,w2  =  1), 


where  a  substitution  from  (5.4.121)  into  (5.4.120)  provides  the  sought  identity 

O^Zj  |  v,,w2  =  1)  =  ct2(Z2  |  v,  ,«2  =  1). 

The  substitution  of  this  identity  of  o2(Z2  |  v,,n2  =  1)  into  (5.4.1 12)  yields 

0-2(Z2  |  V|,«2  ~  0 


<t2(Z2  |  v,  ,m2  =  1)  = 


ar2(Z2  |  v,) 


which  because  of  (5.4. 109)  may  be  extended  to  provide  the  useful  form 


o-2(Z2  |  V|,w2  =  1)  = 


<r2(Z2  |  v,  ,m2  =  1) 
a2(Z2  |  v,) 


j  _  <fr(y2(V|)] 

/*2(v,)  1  P2(v\) 


-  y2(vi) 


(5.4.120) 

(5.4.121) 

(5.4.122) 


(5.4.123) 


(5.4.124) 
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which  allows  a  substitution  into  a  development  from  selection  theory.  This  substitution  will  lead 
to  a  convenient  expression  for  the  variance  of  ability  given  the  outcome  V|  when  a  correct  answer 
to  free-response  Item  2  is  observed. 

_  The  variance  of  Z^(v,)  when  an  incorrect  answer  to  free-response  Item  2  is  observed, 
a2{Z1 1  vuu2  =  0),  is  by  definition 


a2(Z2  |  vuu2  =  0)  =  %(%  |  vuu2  =  0)  -  /jl2(Z2  |  vuu2  =  0) 

fy  (v )  /*x 

=  ]_:  j_x  [^(v,)]2  0*(v,)]  de*(v{)  dUvx) 


-fCX 


kOh)  ViUvd,  0*(v,)]  r/0*(v,)  d(2(yx)\  (5.4.125) 


where  the  joint  density  function  4>*[l2(Vi),  0*(v,)]  is  provided  by  (5.4.78).  Equations  (5.4.78) 
and  (5.4. 125)  may  be  viewed  as  resulting  from  (2.3.49),  (2.3.50),  and  (2.3.85)  after  substitutions 
of  y2(?x)  for  yg,  £2(Vi)  for  0*(v,)  for  0,  and  Q2(vx)  for  Q  Since  y2(v,),  f2(v,),  0*(v,), 
Qiiv,),  and,  consequently,  cr2^  |  V]  ,u2  =  0)  have  respective  definitions  that  correspond  to  those 
of  y%>  Cg >  Qgi  and  cr^Z^,  |  ug  —  0)  in  this  earlier  context,  one  can  then  interpret  the  earlier 
solution  for  a2^  \  ug  =  0),  (2.3.96),  into  the  present  context  as 


cr2(Z2  |  v,  ,«2  =  0)  =  1 


e2(v,) 


f  <t>[y2(vi)] 

1  Qi(v  i) 


+  T^OlU, 


(5.4.126) 


which  provides  the  variance  of  Z2(v,)  when  an  incorrect  answer  to  Item  2  is  observed. 

Because  of  (5.4.57),  (5.4.66),  and  (5.4.80),  an  abbreviated  form  of  (5.4.125)  may  be 
written  as 


cr2(Z2  |  v,,u2  =  0)  =  —  l  [%(Z?2  |  v,,h2  =  0)  -  ix2{Z2  \  vuu2  -  0)],  (5.4.127) 

a  \^2  \  v\) 

where  the  expression  in  brackets  is  a  variance.  This  expression,  by  definition,  is  the  variance  of 
Z,(v,)  when  an  incorrect  answer  to  Item  2  is  observed.  The  equation  for  this  variance  then  is 

ct2(Z2  |  vuu2  =  0)  =  %(2%  |  v,,«2  =  0)  -  )x2(Z2  |  Vi,«2  =  0).  (5.4.128) 

A  substitution  from  (5.4.128)  into  (5.4.127)  allows  one  to  write 

or2(Z2  |  V,  ,u2  =  0) 

a\Z2  |  v,,«2  =  0)  =  - j— — - ,  (5.4.129) 

cr  {Z2  |  v,) 

where  a2(Z2  |  Vj,  u2  =  0)  has  an  identity  which  after  substitution  into  (5.4.129)  provides  a  more 
useful  expression. 

In  solving  for  this  identity,  it  is  necessary  to  examine  further  the  expected  value 
%{Z^  |  vuu2  =  0).  Because  of  (5.4.66),  this  expected  value  of  squared  mean  deviates  may  be 
expanded  as 


%{Z}2 1  Vj  ,u2  =  0) 


n 
-rx 


[£2(v,)]2  ^t[C2(v,),  0*(V,)]  d&*(v\)  d£2{vx) 

ICi  -  /x(Z2  |  v,)]2  ^[^(v,),  0*(v,)]  de*  dl2(v ,) 


■  oc  J  —0 c 


Ci  0*(v,)]  </0*(v,)  #2(v,) 


-2fi.(Z2  |  v, ) 


^(v.)  roc 


oc  J  — oc 


Ci  Xt&Oh),  0*(v,)]  dd*(vt)  dl2{vx) 


+  H2(Z2 


/*w  r* 

’■>  L  I 


<f>flii(y ,),  0*(v,)]  rf0*(v,)  dC2{v i ),  (5.4.130) 
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where,  as  a  matter  of  convenience,  the  constant,  fi(Z2 1  Vj)  or  (i2{Z2  \  Vj),  has  been  moved  outside 
of  two  of  the  double  integrals.  In  the  last  equality  in  (5.4.130),  the  first  double  integral  defines 
%{Z\  |  Vj,«2  =  0),  where  one  then  has 

%(Zl  I  v„«2  =  0)  =  p'j’  f  x  £  4>+[&(v i),  fl*(v,)]  dd*(Vl)  d,Uvx)\  (5.4.131) 

and  the  second  double  integral  defines  jx(Z2  |  v,,m2  =  0),  where  one  has 

fi(Z2 1  v,,«2  =  0)  =  Jjj’  J  "  £ 2  0*(v,)]  de*(vt)  dUvx).  (5.4.132) 

Substituting  from  (5.4.78),  (5.4.131),  and  (5.4.132)  into  (5.4.130),  one  may  write 
^{Z\  |  V\f  u2  =  0) 

=  %{Z\  |  V\ ,m2  =  0)  -2fi (Z,  |  fi(Z2  |  vuu2  =  0) 


+ 


^2(Z2  |  Vi) 


o: 


0*(vi)]  d$*(Vi)  dM?i),  (5.4. 133) 


e2(v,) 

where  this  equation  may  be  simplified  to 

%(Zz  I  V|,  U2  =  0) 

=  %{Z\  I  v,,«2  =  0)  -2n-(Z2  I  v,)  /z(Z>  I  V,,tt2  =  0) 

+  /x2(Z2  |  v,)  (5.4.134) 

because  of  (5.4.60).  A  substitution  from  (5.4.134)  into  (5.4.128)  now  provides 
<t2(Z2  |  v„  u2  =  0) 

=  %{Z\  |  V|,m2  =  0)  —  2/x(Z>  |  v,)  fi(Z2  |  v, ,u2  =  0) 

+  n ?{Z2  |  v,)  -  /a2(Z2  |  v,,m2  =  0),  (5.4.135) 

where  a  further  substitution  from  the  squared  result  of  (5.4.86)  into  (5.4.135)  yields 
<t2(Z2  |  v,,  m2  =  0) 

=  %(Z\  |  v,,w2  =  0)  —  2/ i(Zj  |  v,)  M(Z2  |  v,,w2  =  0) 

+  ,u2(Z2  |  v,)  -  m2(Z2  |  vx,u2  =  0) 

+  2/x(Z2  |  v,)  /x(Z2  |  V|,m2  =  0)  -  m2(Z2  I  f,).  (5.4.136) 

The  cancellation  of  terms  in  (5.4.136)  provides 

cr2(Z2  |  vx,u2  =  0)  =  %{Z\  |  v j ,w2  =  0)  —  fx2(Z2  \  vuu2  =  0).  (5.4.137) 

But,  by  definition,  one  has 

<x2(Z2  |  v,,w2  =  0)  =  %{Z\  |  v,,m2  =  0)  -  yu.2(Z2  |  v, ,«2  =  0),  (5.4.138) 

where  a  substitution  from  (5.4.138)  into  (5.4.137)  provides  the  sought  identity 

o-2(Z2  |  v, ,m2  =  0)  =  cr2(Z2  |  v, ,w2  =  0).  (5.4.139) 

The  substitution  of  this  identity  of  o2(Z2  |  v,  ,u2  =  0)  into  (5.4.129)  now  yields 

a2(Z2  |  v,  ,u2  =  0) 


cr2(Z2  |  v,  ,u2  =  0)  = 


o-2(Z2  |  v,) 


(5.4.140) 


which  because  of  (5.4.126)  may  be  extended  to  provide  the  useful  form 
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(5.4.141) 


cP-(Z2  |  r,  ,«2  =  0)  = 


o-2(Z2  |  v,,h2  =  0) 
a2(Z2  |  v,) 


0[y2(vi)1 

Qi(v .) 


[»[%(»,)] 
l  e2(v,) 


+  T2(V,) 


which  allows  a  substitution  into  a  development  from  selection  theory.  This  substitution  will  lead 
to  a  convenient  expression  for  the  variance  of  ability  given  the  outcome  v,  when  an  incorrect 
answer  to  free-response  Item  2  is  observed. 


Given  the  three-parameter  normal  ogive  submodel,  the  updating  assumption,  and  the  previous  outcome 


The  variance  of  Z2(v J)  when  a  correct  answer  to  multiple-choice  Item  2  is  observed, 
o2(Z2  |  v\  yu2  =  1),  is  defined  by 

a2(^2  I  vl>w2  =  1)  =  %{Z\  |  vj,«2  =  1)  -  /x2(Z2  |  v[,«2  =  1) 

roc  roc 

=  Jy2(y;>  J-,  [^(V!)]2  *«)]  <&(vj) 

fvi'  f* 

!J-0 0  J-> 


+  c2 


f  /■ 

JW i>  J* 


l(2(y\)]2  i),  42(v|) 


&(»i)  0*(vj)]  42(vi) 


feW)  <A*'[&(vi),  fl*(vj)]  J0*(vj)  rf£2(v|)  1  ,  (5.4.142) 


+  c2 


where  the  joint  density  function  4>*'[£2(v|),  0*(v',)]  is  provided  by  (5.4.88).  Equations  (5.4.88) 
and  (5.4. 142)  may  be  viewed  as  resulting  from  (3.3. 1 1),  (3.3. 12),  and  (3.3.34)  after  substitutions 
of  y2(vj)  for  yg,  £2{v\)  for  £g,  0*(v|)  for  0,  P'2(v\)  for  P'g,  and  c2  for  cg.  Since  y2(v\ ),  l2{v\), 
0*(v|),  P'2(v\),  c2,  and,  consequently,  (p-(Z2  |  v\,u2  =  1)  have  respective  definitions  that  corre¬ 
spond  to  those  of  yg,  £g,  6,  P'g,  cg,  and  cr2(Zg  \  u'g  =  1)  in  this  earlier  context,  one  can  then 
interpret  the  earlier  solution  for  a2(Zg  |  u'g  =  1),  (3.3.42),  into  the  present  context  as 

a2(Z2 1  v\,u2  =  1) 


...  ,  a  -  ci)  <t>ly2(v\)]  [(1  -  c2)  4>[y2(v\)]  ,  , 

-  I  rr— ^  ' - — - 72(vi)  f  > 


P'M) 


P'M) 


(5.4.143) 


which  provides  the  variance  of  Z>(vJ)  when  a  correct  answer  to  a  multiple-choice  Item  2  is 
observed. 

Because  of  (5.4.57),  (5.4.66),  and  (5.4.90),  an  abbreviated  form  of  (5.4.142)  may  be 
written  as 


2(Z2  |  V,  ,«2  _  1)  — 


<t2(Z2  |  vj) 


—  \$(Z\  I  v\,u2  =  1)  -  n2(Zl  I  v[,u2  =  1)],  (5.4.144) 


vyhere  the  expression  in  brackets  is  a  variance.  This  expression,  by  definition,  is  the  variance  of 
Z2(ZI)  when  a  correct  answer  to  Item  2  is  observed.  The  equation  for  this  variance  then  is 


cP-{Z2  |  v\,u2  =  1)  =  %{Z\  |  vi,u2  =  1)  -  fi \Z2  |  v\,u2  =  1). 
A  substitution  from  (5.4.145)  into  (5.4.144)  allows  one  to  write 

ct2(Z2  |  v\,u2  =  1) 


<t2(Z2  |  vj  ,u2  —  1)  = 


ct2(Z2  |  vj) 


(5.4.145) 


(5.4.146) 


where  a1(Z2 1  vj  ,u2  =  1)  has  an  identity  which  after  substitution  into  (5.4.146)  provides  a  more 
useful  expression. 
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In  solving  for  this  identity,  it  is  necessary  to  examine  further  the  expected  value 
^>(Z2  I  v[yu2  -  !)•  Because  of  (5.4.66),  this  expected  value  of  squared  mean  deviates  may  be 
expanded  as 

%{Z\  |  =  1) 


-/■  f 


+  c2 


[kW  4>*'[Uv[),  de*(v i)  dl2{v\) 


-r  r 

j  -3 


]yiv  i> 
+  c2 


ry,(vj)  roc 

J_x  J_x  [<r2(vi)]2  0*(vj)]  40*(vj)  <&(vj) 

[&  -  I  v;)]2  0*'[|2(v;),  e*(v;>]  ^pj)  <^2(vj) 


■l 


J  - 


p2<-i>  p 

J_x  J_K  16  -  |  v|)]2  e*(vi)i  ^(vi)  <%(*;) 

$  **'[&(f|),  0*(vj)]  rf^(vj)  </&(*{) 

roc  roc 

—  2fj,(Z2  |  vj)  J  £2  <P'[£2(v{i*(v''1),  0*(vj)]  r/0*(vj)  rf£2(vj) 

^  ^2'V|)  J  -0C 

rw  roc 

+  M2(^2  I  Vi)  J_x  </>*'[£2(v j),  cf  1 )]  </fl*(Fj)  J£2(vj) 


+  c2 


n: 


£  fl*(vi)]  </0*(vJ)  <&(vj) 


rv-i»  p 

-2  c2  m(Z2  I  v})  J_3C  J_^  &  <P'P2(vj),  fl*(vj)]  </0*(vj)  42(vJ) 


+  c2  p,2(Z2  |  vj) 


fvvj)  r* 

J  ~OC  J  — 3 


0*'[&W).  ^(vj)]  <%W), 


(5.4.147) 


where  the  constant,  /x(Z2  |  vj)  or  p(Z2  |  vj),  has  been  moved  outside  of  four  of  the  double 
integrals  for  the  purpose  of  convenience.  By  definition,  it  is  known  that 

%{Z\  |  v[,u2  =  1) 

roc  roc  roc 

=  V;,  J  J_»  £  VliM),  0*(vj)]  de*(v j)  dlM) 

f*2,ri>  p 

+  °2  J_x  j_x  &  r'UM),  e*(v\)]  de*(v j)  dC2(v j),  (5.4.148) 

which  may  be  substituted  into  (5.4.147).  After  this  substitution  and  some  rearrangement,  one  may 
write 

%(zi\v\y2  =  i)  =  %(z\\  v;,«;  =  i) 


-  2 n(Z2  |  v 


»fr  r 

[Jy2^o  J~ 


(2  4>*'lii(y i),  0*(v[)]  d6*(v[)  di2(v[) 


+  c2 


ir 


(: 2  4>*’Uz M),  e*(rjw  ^*(vj)  rf&O'j) 


+  M2(Z2  I  vj) 


^i) 


/: 


4>*'[<r2(vj),  0*(vj)]  </0*(yJ)  4>(vj) 


+  c2 


n: 


^'[^(vj),  0*(vj)]  ^(vj)^2(vj)  , 


(5.4.149) 
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an  equation  that  can  be  further  simplified.  By  definition,  one  has 

fJL(Z2  I  v\,u'2  =  1) 

=  f  f  ZiP'l&M).  6*(v\)]  d'e*(v\)  d£2(v\) 

Jyz(v'0  J  -* 

+  C2  JjJ  f_x  Ci  <t>*'[Ci(v J).  0*(vj)]  d8*(v\)  dUv |),  (5.4.150) 


which  may  now  be  substituted  into  (5.4. 149).  After  substitutions  from  (5.4.88)  and  (5.4. 150)  into 
(5.4.149),  it  is  known  that 

^(^2  I  vi  >w2  =  1) 

=  % (Z2  I  vi  Ml  =  1)  -  I  vi)  m(Z2  I  v;,«2  =  1) 

+  LV|)  1  f  f  W|)]  ^*(vi)  d&M) 

p2(vi)  |_Jy2(v|,  J-* 

f^'i’  fx  .  ] 

+  C2  J  x  J  x  *&«),  fl*(vi)]  ^(vi)  ^2(vi)  .  (5.4  151) 

which  can  be  written  as 

^(^2  |  vi  ,w2  ==  1 ) 

=  %{Z\  |  Vj ,w2  =  1)  -  2fx(Z2  |  vi)  ju(Z2  |  vi,^  =  1)  (5.4.152) 

+  fS(Z2 1  vi) 

because  of  (5.4.62).  A  substitution  from  (5.4.152)  into  (5.4.145)  now  leads  to 

or2(Z2  |  vj,w2  =  1) 

=  %(Z\  |  vj ,w2  =  1)  -  2 m(Z>  I  v!)  I  vj,w2  =  1) 


+  ^2(Z2  |  vi)  -  (jl2(Z2  |  vj ,w2  =  1), 
where  a  further  substitution  from  the  squared  result  of  (5.4.96)  yields 

cr2(Z2  I  vj  ,w2  =  1)  =  %{Z\  I  vj  ,w2  =  1)  -  2 fx(Z2  |  vi)  \x{Z2  I  V]  ,u2  =  1) 
4-  (x 2(Z2  |  vi)  -  \x\Z2  |  Vj ,w2  =  1) 

+  2 fx(Z2  |  vi)  fi(Z2  |  vj ,w2  =  1)  -  [x\Z2  |  vi). 
The  cancellation  of  terms  in  (5.4.154)  provides 

cr2(Z2  |  vj,w2  =  1)  =  %(Z?i  |  Vj,w2  =  1)  —  ix2 (Z2  |  Vj ,m2  =  1). 


But,  by  definition,  one  has 

v\Z2  |  vi,w2  =  1)  =  %(Z\  |  v\,u'2  =  1)  -  /x2(Z2  |  vi,«2  =  1), 
where  a  substitution  from  (5.4.156)  into  (5.4.155)  provides  the  sought  identity 

cr2(Z2  |  v\,u2  -  1)  =  ct2(Z2  |  vi,w2  =  1). 

The  substitution  of  this  identity  of  o 2(Z2  \  v\  ,u2  =  1)  into  (5.4.146)  yields 


<i\Z2  |  v],m2  =  1)  = 


(T2(Z2  j  v\,U2  =  1) 
cr2(Z2  I  vi) 


which  because  of  (5.4.143)  may  be  extended  to  provide  the  useful  form 


(5.4.153) 

(5.4.154) 

(5.4.155) 

(5.4.156) 

(5.4.157) 

(5.4.158) 
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<T2(Z2  |  Vj  ,«2  =  1 )  = 


OT2(Z2  |  v\,u2  =  1) 
a\Z2  I  v\) 


(i  -  £2)  <f>[y2W]  JO  -  c2)  <A[y2(vl)] 


^2(vi) 


W) 


“  TzO'in,  (5.4.159) 


which  allows  a  substitution  into  a  development  from  selection  theory.  This  substitution  will  lead 
to  a  convenient  expression  tor  the  variance  of  ability  given  the  outcome  vl  when  a  correct  answer 
to  multiple-choice  Item  2  is  observed. 


_  The  variance  of  Z2(v\)  when  an  incorrect  answer  to  multiple-choice  Item  2  is  observed, 
cr2(Z2  I  v[,u2  =  0),  is  by  definition 


CT2(Z2  I  vj,w2  —  0)  —  %{Z2  |  vj  ,«2  —  0)  —  fJL2(Z2  |  vj,w2  =  0) 


=  (1  -  C2) 

I  “  C2) 


n: 


16M)]2  tf’liM),  0*(vj)]  dd*{v  j)  d£2(v i) 


irr 


Z2M)  4>  [&(vj),  0*(vi)]  d8*(v j)  d£2(v J)  , 


(5.4.160) 


where  the  joint  density  function  $f'[£2(v[),  0*(vj)]  is  provided  by  (5.4.98).  Equations  (5.4.98) 
and  (5.4. 160)  may  be  viewed  as  resulting  from  (3.3.22),  (3.3.23),  and  (3.3.45)  after  substitutions 

of  y2(v\)  for  yg,  &(vj)  for  £g,  0*(vj)  for  6,  Q'2(v\)  for  Q'g,  and  c2  for  Cg.  Since  y2(vj), 

&(vi),  Q2(v j),  Q2(v\),  c2,  and,  consequently,  a\Z2  |  v\,u'2  =  0)  have  respective  defi¬ 

nitions  that  correspond  to  those  of  yg,  (g,  6,  Q'g,  Qg,  Cg,  and  a2(Zg  \  u'g  =  0)  in  this  earlier 

context,  one  can  then  interpret  the  earlier  solution  for  cr^Z  |  u'g  =  0),  (3.3.50),  into  the  present 
context  as  r 


ct2(Z2  |  vj  ,u2  =  0)  =  1 


Qiiv  I) 


72(^1)] 

l  QiW 


+  72(>’i)f. 


(5.4.161) 


which  provides  the  variance  of  Z2(v|)  when  an  incorrect  answer  to  Item  2  is  observed. 

Because  of  (5.4.57),  (5.4.66),  and  (5.4.100),  an  abbreviated  form  of  (5.4.160)  may  be 
written  as 


o-2(Z2  |  vj  ,u2  =  0)  = 


1 


ct2(Z2  |  vj) 


[%(Z%  I  v\,u'2  =  0)  -  yu,2(Z2  I  vj ,u2  =  0)],  (5.4.162) 


where  the  expression  in  brackets  is  a  variance.  This  expression,  by  definition,  is  the  variance  of 
Z2(vi)  when  an  incorrect  answer  to  Item  2  is  observed.  The  equation  for  this  variance  then  is 

I  =  0)  =  %{Z\  |  v\ ,u2  =  0)  -  /r2(Z2  |  vj ,u2  =  0).  (5.4.163) 

A  substitution  from  (5.4.163)  into  (5.4.162)  allows  one  to  write 

cr2(Z2  |  vj  ,u2  =  0) 

^(Z2 1 -  0)  -  -  ^ .  isaim) 

where  <x2(Z2  |  vj,w2  =  0)  has  an  identity  which  after  substitution  into  (5.4.164)  provides  a  more 
useful  expression. 

In  solving  for  this  identity ,  it  is  necessary  to  examine  further  the  expected  value 
%{Z2  |  v,,m2  =  0).  Because  of  (5.4.66),  this  expected  value  of  squared  mean  deviates  may  be 
expanded  as 
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%{Z\  I  vj,«2  =  0)  =  (1  -  c2) 


jr  i: 


[faMM2  ^'[&(vi),  fl*(v',)]  </0*(v',)  rff2(v{) 


rv'i>  r*  .... 

=  (l  -  C2)  J_K  J_x  [&  -  MZi  I  v!)]2  tf'[{2(v i),  «*(»',)]  dfl*(v|)  rffeM) 

fv:>  r* 

=  (1  -  C2)  J  ^  J  x  £  0+'[^2(v',),  0*(vi)]  </0*(v|)  rf&W) 

rvi1  f“  .... 

-  2(1  -  c2)  m(^  |  vl)  j _  j  x  &  0*(v',)]  d0*(vl)  rf&(vi) 

fv?  r  - 

+  (1  -  c2)  /x2(Z2  I  vl)  J  x  J  x  0*(vi)]  </0*(v',)  rf&W),  (5.4.165) 

where,  as  a  matter  of  convenience,  the  constant,  p.(Z2  |  vl)  or  /j.  2(Z2  |  vj),  has  been  moved  outside 
of  two  of  the  double  integrals.  In  the  last  equality  in  (5.4. 165),  the  product  of  (1  -  c2)  and  the 
first  double  integral  defines  %{Z\  |  vj,n2  =  0)  where  one  then  has 

%(Z\\v\,u'1  =  0) 

fwP  rx  .... 

=  (1  -  C2)  J  x  J  x  cl  tf'Uiiv  1).  0*(v',)]  d&*(v\)  dCM),  (5.4.166) 

and  the  product  of  (1  —  c2)  and  the  second  double  integral  defines  /u.(Z2  |  vl,n2  =  0),  where  one 
has 


tx(Z2  |  vj  ,m2  =  0) 

=  (1  -  c2) 


L  L  * 


ICM),  0*00]  de*(v[)  d'CM).  (5.4.167) 


Substituting  from  (5.4.98),  (5.4.166),  and  (5.4.167)  into  (5.4.165),  one  may  write 

|  v\  Mi  —  0) 

=  %(Z\  I  v\,u2  =  0)  -  2fi(Z2  I  vj)  fx(Z2  I  V|',m2  =  0) 

<0  ""g!(v;)V|)  f-J  ^^(vi),  0*00]  de*(v\)  dCM),  (5.4.168) 


+  (1 


where  this  equation  may  be  simplified  to 

%{Z\  I  vj ,n2  =  0)  =  %{Z\  I  v; ,u2  =  0)  -  2fx(Z2  |  vj)  fi (Z2  |  v\,u'2  -  0) 

+  M2(Z2|vl),  (5.4.169) 

because  of  (5.4.64).  A  substitution  from  (5.4.169)  into  (5.4.163)  now  provides 
<t2(Z2  |  vi,«2  =  0) 

=  %(Z\  |  vj ,u2  =  0)  -  2MZ,  |  vl)  M(^2  I  vJ,«J  =  0) 

+  /x2(Z2  |  vj)  -  h2(Z2  |  v{ ,n2  =  0),  (5.4.170) 

where  a  further  substitution  from  the  squared  result  of  (5.4.106)  into  (5.4.170)  yields 

a\Z2  |  vj,t4  =  0)  =  %{Z\  |  v\,u'2  =  0)  -  2fx(Z1  \  v[)  pt(Z2  |  vj,^  =  0) 

+  ^(Z2  |  v\)  -  v2(Z2  |  vi,«;  =  0) 

+  2 n(Zi  |  v|)  fx(Z2  |  vj ,w2  =  0)  -  ^2(Z2  |  vj).  (5.4.171) 
The  cancellation  of  terms  in  (5.4.171)  provides 

cr2(Z2  |  v\,u'2  =  0)  =  *(Zi  |  vj ,n2  =  0)  -  I  »0«2  =  0).  (5.4.172) 
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(5.4.173) 


But,  by  definition,  one  has 


cr2(Z2  |  v\,u'2  =  0)  =  %{Z\  |  vj ,u2  =  0)  -  p.2(Z2  |  v[,u'2  =  0), 
where  a  substitution  from  (5.4.173)  into  (5.4.172)  provides  the  sought  identity 

o-2(Z2  |  v\,u'2  =  0)  =  ct2(Z2  |  v;,w2  =  0). 

The  substitution  of  this  identity  of  cr2(Z2  |  v\,u2  =  0)  into  (5.4.164)  yields 


|  vj  ,w2  =  0) 


g-2(Z2  |  vj  ,m2  =  0) 
<t\Z2  |  vj) 


(5.4.174) 


(5.4.175) 


Because  of  (5.4.161),  equation  (5.4.175)  may  now  be  extended  to  provide  the  useful  form 


cr2(Z2  |  vj  ,u2  =  0)  = 


o-2(Z2  |  vj  ,«2  =  0) 
<t\Z2  |  vj) 


G2(v',)  1  G2(vj) 


+  y2(vj) 


(5.4.176) 


which  allows  a  substitution  into  a  development  from  selection  theory.  This  substitution  will  lead 
to  a  convenient  expression  for  the  variance  of  ability  given  the  outcome  vi,  when  an  incorrect 
answer  to  multiple-choice  Item  2  is  observed. 


The  derivations  culminating  in  (5.4.122),  (5.4.139),  (5.4.157),  and  (5.4.174)  demonstrate  the  principle 
that  the  variance  of  a  variable  is  unchanged  by  the  addition  of  a  constant.  The  continuous  variable  Z2(vf )  equals 
the  continuous  variable  Z2  plus  a  constant.  In  the  general  case,  this  additive  constant  is  the  negative  of 
M(^2  I  vf). 

A  generalized  form  for  the  variance  of  the  standardized  continuous  variable  Z2(vf )  given  the  realizations 
of  the  binary  variable  f/f  may  now  be  written.  As  can  be  deduced  from  (5.4.123),  (5.4.140),  (5.4.158),  and 
(5.4.175),  this  expression  takes  the  form 


o-2(Z2  |  vf  ,U$) 


tr2(Z2  |  vf,C/f) 
a2(Z2  |  vf) 


(5.4.177) 


The  Correlation  Between  Z3  and  O*  Given  the  Outcome  Vector  v\,  p(Z3,0 1  v*2) 


In  obtaining  an  explicit  solution  for  p(Z3,0  |  vf)  one  begins  by  deriving  expressions  for  p2(Z2,Z3  |  vf) 
and  p2(Z2,0  |  vf)  for  later  substitution  into  the  first  two  equalities  in  (5.3.56).  In  solving  for  p2(Z2,Z3  |  vf), 
one  obtains  an  explicit  solution  for  o-(Z3  |  vf)  from  the  first  two  equalities  in  (5.3.52).  This  solution  yields 


or(Z3  |  vf) 


p(Z2,Z3  |  vf)  q-(Z3  |  vf) 
p(Z2,Z3  |  vf)  a(Z2  |  vf) 


(5.4.178) 


where,  upon  squaring  (5.4.178)  and  substituting  from  the  result  into  the  first  two  equalities  in  (5.3.54),  some 
rearrangement  provides 


(z2(Z3|vf)  [1  -p2(Z2,Z3|vf)]  =  p2(Z2,Z3| vf)  — Z3l2flf?|Vf) 


<r2(Z2\vf)  [y(^,Z3|vf) 

Dividing  (5.4.179)  by  the  product  <t 2(Z3  |  vf)  p2(Z2,Z3  |  vf),  one  has 


-  1 


1 


p2(Z2,Z3  I  vf) 


-  1  = 


o-2(Z2  |  vf) 

^(Z,  |  vf)  |_P2(Z2,Z3  |  vf) 


-  1 


where  an  explicit  solution  for  p2(Z2,Z3  |  vf)  yields 


p2(Z2,Z3  |  vf)  =  1  + 


o^(Z2  |  vf) 

<t2(Z2  |  vf)  |_p2(Z2,Z3  |  vf) 


-  1 


(5.4.179) 


(5.4.180) 


(5.4.181) 
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In  solving  for  p2(Z2,0  |  vf),  one  obtains  an  explicit  solution  for  a(0*  \  vf)  from  the  first  two  equalities  in 
(5.3.53).  This  solution  yields 


cr(Q*  |  vf)  = 


p(Z2,0  1  vf)  oj6*  \  vf ) 
p(Z2,0  I  vf)  cr(Z2  I  vf) 


o-(Z2  |  vf) 


(5.4.182) 


where,  upon  squaring  (5.4.182)  and  substituting  from  the  result  into  the  first  two  equalities  in  (5.3.55),  some 
rearrangement  provides 


0-2(0*  |  vf)  [1  -  p2(Z2,0 1  vf )]  =  p2(Z2, 0|vf) 


cr2(©*  |  vf )  cr2(Z2 1  vf) 


cr2{Z2 1  vf ) 

Dividing  (5.4.183)  by  the  product  (^(O*  |  vf)  p2(Z2,0  |  vf),  one  has 


p2(Z2,9  |  vf) 


Q-2(Z2  1  vf) 

cr{Z2 1  vf) 


p2(Z2,0  I  vf) 


,P2(Z2,0  |vf) 


-  1 


(5.4.183) 


(5.4.184) 


where  an  explicit  solution  for  p2(Z2,0  |  vf)  now  yields 

(j\Z2  |  vf) 


p2(Z2,0|  vf)  =  1  + 


m2(Z2 


vf) 


p2(Z2,0  |  vf) 


-  1 


(5.4.185) 


After  appropriately  substituting  the  results  of  (5.4.181)  and  (5.4.185)  into  the  first  two  equalities  in 
(5.3.56),  one  obtains 

p(Z3,0  I  vf)  -  p(Z2,Z3  I  vf)  P(Z2,0  I  vf) 

V  I  -  p2(Z2,Z3  |  vf)  Vl  -  p2(Z2,6>  |  vf) 


(5.4.186) 


where  the  equality  on  the  right  side  can  be  simplified.  By  placing  the  terms  under  the  radicals  on  common 
denominators  and  subtracting  terms  in  the  numerators,  one  obtains 


p(Z3,o  |  vf) 


i  + 


2(Z2  ]  vf) 

\z2  |  vf)  |_p2(Z2,Z3  vf) 


1 


1  + 


o~2(Z2  |  vf) 
;(Z2  |  vf) 


cr 


1 


_p2(Z2,0  I  vf) 


-  1 


/  m2(Z2  1  vf) 

J_  i 

/  <?aAvt) 

r  1  ,i 

/  ^(^2 

vf) 

p-)Z2,Z,  |  vf) 

1  . 

vf) 

_pHZ1,a\  vf) 

+ 


<r2(Z2  |  vf ) 

1  ll  1 

1  J.  1  ff) 

f  l  ,1 

(72(Z2  |  vf) 

_P~(Z 2»^3  1  Vl)  J 

V  triZi !  vf) 

_pz{Z2,()  |  vf) 

(5.4.187) 


Multiplication  of  the  numerator  and  denominator  of  (5.4.187)  by  the  square  roots  of  the  denominators  under  the 
radicals,  along  with  some  later  rearrangement,  leads  to 


p(Z3 , 0  |  vf) 


a2(Z2  |  vf) 
a2(Z2  |  vf) 


1 

p2(Z2,Z3  I  vf) 


1  + 


(72(Z 2  1  Vf) 

cr2(Z,  |  vf) 


P2(Z2.0|  vf) 


1 


cr2(Z2  |  vf)  /  i 


P2(Z2,0  |  vf) 


(5.4.188) 


where  multiplication  of  the  numerator  and  denominator  by  the  ratio 
rearrangement,  leads  to 


o^(Z2  1  vf) 
o2(Z2  |  vf) 


along  with  some  later 
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p(z3,e  |  vf)  | 

r  °"2(z2  t  vf)  i  i 

n 

\  ct2(Z2  |  vf)  1  1 

1  5  ct2(Z2  1  vf ) 

Lcr2!^  (  vf)  p2(Z2,Z3 1  vf)  J 

1  o-2(Z2  |  vf) 

p2(Z2,0|  vf)  ] 

1  o"2(Z2  |  vf) 

p(Z2,z3  |  vf)  y 

/l  -  p2(Z2,Z3  I  vf) 

p(Z2,0|  vf)  yj 

'  i  -  p2(Z2,e  |  vf) 

(5.4.189) 

Multiplication  of  the  numerator  and  denominator  in  (5.4.189)  by  p(Z2,Z3  |  vf)  and  p(Z2,0  |  vf),  along  with 
subsequent  rearrangement,  leads  to 

.5 


p(Z),0  |  vf) 


{ 1  -  pHZ,,Z, 


j  |  vf ) 


1  - 


o-2(Z2  |  Vf) 

cr{Z2  |  vf) 


1  -  p2(Z2,0  |  vf ) 


1  - 


0^( z2  1  vf) 


a\Z2  |  vf) 


-  p{Z2,Z3  |  vf)  p{Z2,0  |  vf) 


v2(Z2  |  vf) 

(j2{Z2  |  vf ) 


y  1  “  P2(Z>,Z,  |  vf)  1  -  p2(Z2,Q  |  vf) 

(5.4.190) 

which  may  be  substituted  back  into  (5.4.186)  for  the  expression  on  the  right  side  of  the  equality.  This  substitution 
provides 

p(Z3,0  |  vf)  -  p(Z2,Z3 1  vf)  p(Z2,G  1  vf) 


1  -  p~ ( Z2 , Zy  |  vf )  / 1  -  p2(Z2rO  |  vf ) 


p(Z„o  |  vf )  j  i  -  p2 ( Z2 , Zy  |  vf) 

j  cr2(Z2  |  vf ) 
crtZ,  |  v?) 

j  1 1  -  p2(Z,,0  |  vf) 

cr^Z,  |  vf) 
(T^Z,  |  vf)_ 

]  -  p(z2,z3 1  vf)  p(z2,e  1  vf)  -r-'* 

J  cr-(Z2  |  vf) 

> 

-  p\Z2,Z3  |  Vf)  1  - 

p2cz2,e  |  vf) 

where  multiplication  of  both  sides  of  this  equation  by  the  common  denominator  yields 

p(Z],o  |  vf)  -  p(z2,z3 1  vf)  p(z2, e  |  vf) 

-i  ^  .5 


=  P(Z3,0  |  vf)  ■{  1  -  p2(Z2,Z3  |  vf) 


^{Zj  1  vf) 

o2(Z2  |  vf) 


*  ~  P2(Z2,0  |  vf) 


p(Z2,Z3  |  vf)  p(Z2,0  |  vf)  y  1  Vr) 


ct2(Z2  I  vf) 

Through  transposing  and  combining  expressions  in  (5.4.192)  one  obtains 
p(Z3 , 0  I  vf) 


(5.4.191) 


o'2  (Z2  1  vf) 

ct2(Z2  |  vf )_ 

(5.4.192) 


=  p(Z3,0|  vf)  1 1  -  p2(Z2,Z3|  vf) 
+  p(Z2,Z3  I  vf)  p(Z2,0  I  vf) 


1  - 


o2(Z2  |  vf) 

a2(Z2  |  vf) 


-i  ^  .5 


1  -  p\Z2,Q  I  vf) 


1  - 


o-2 (Z2  |  vf) 
<t\Z2  j  vf) 


.5 


0-2 (Z2  |  vf) 
a2(Z2  |  vf) 


(5.4.193) 


which  allows  one  to  proceed  to  a  convenient  expression  for  an  explicit  solution  to  p(Z3,0  |  vf). 

Solving  the  first  two  equalities  in  both  (5.3.52)  and  (5.3.53)  explicitly  for  p(Z2,Z3  |  vf)  and 
p(Z2,0  |  vf),  respectively,  one  obtains 


,7  7  \  *\  r  7  7  \  ±\  °^Zi  vf)  a(Z2  vf) 
p(Z2,Z3  |  vf)  =  p(Z2,Z3  vf)  —  Tt  \  IT 

o-(Z2  vf)  a(Z3  vf 


and 


p(z2,e|  vf)  =  p(Z2,©|  vf) 


ar{0*  I  vf)  cr(Z2  |  vf) 
a(Z2  |  vf)  cr(0*  |  vf) 


(5.4.194) 


(5.4.195) 
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where  squared  and  unsquared  substitutions  from  (5.4.194)  and  (5.4.195)  into  (5.4.193),  along  with  later  rear¬ 
rangement,  lead  to 

p(Z3,0  |  vf) 


=  P(Z3,0  I  vf) 


1  -  p2(Z2,Z3  I  vf) 


1  vf) 


+  p(z2,z3 1  vf)  p(Z2,e  |  vf) 


d(Zy  I 


^(Z3\ 

vf)  (7(0* 


vf) 

K) 


<x(Z3  I  vf)  <7(0*  |  vf) 


o2(Z2  1  vf) 

,^(Z2 1 
o^(Z2 


vf) 

I  vf) 


-  1 


1  -  p2(Z2,0  I  vf) 


0^(0*  |  vf) 
(r2(0*  |  vf) 


(72(Z2  |  vf) 


^(^2  |  Vf) 

<72(Z2  |  vf) 


-  1 


(5.4.196) 


In  simplifying  (5.4.196)  further,  one  will  want  to  substitute  for  p(Z2,Z3  |  vf).  A  convenient  expression 
for  this  correlation  will  now  be  derived  for  later  substitution  into  (5.4. 196).  In  the  restricted  updating  procedure, 
0*(vf)  is  assumed  to  be  normally  distributed.  Thus  (1.1.12)  may  be  rewritten  in  this  context  as 

Z(vf)  =  P(vf)  0*(vf)  +  A  for  all  Z^(vf)  where  g  ^  g(1).  (5.4.197) 

Since  linear  combinations  of  normally  distributed  variables  are  also  normally  distributed  (Anderson,  1958),  one 
has 

Z(vf)  ~  N{fl(vf)  p(0*  |  vf),  2[Z(vf),  Z(vf)]},  (5.4.198) 


where  the  (p—  l)-by -(p-  1)  variance-covariance  matrix  S[Z(v f),  Z(vf)]  can  be  decomposed  into 

2[Z(v f),  Z(vf)]  =  P(vf)  P(v? Y  (72(0*  |  vf)  +  X(A,A).  (5.4.199) 


Because  the  variance-covariance  matrix  X(A, A)  is  diagonal,  that  is  measurement  errors  are  undisturbed  by  prior 
explicit  selection  on  Z,  and  are  independent  from  ZR  to  Zh  where  g  does  not  equal  h  for  the  remaining  items, 
one  has  as  the  off-diagonal  element  in  the  gth  row  an  foh  column  of  the  matrix  X[Z(v f),  Z(vf)],  the  covariance 

<r[Zg(v f),  Zh(v f)]  =  (3g(vf)  a2(0*  |  vf).  (5.4.200) 


In  (5.4.200),  the  regression  coefficients  j8^(vf)  and  j8/,(vf),  those  which  predict  Z?(vf)  and  Zh(y f )  given  0*(vf ), 
are  by  definition 


and 


j8j(vf)  =  P(zg9e  |  vf) 


Ph(v f)  =  P(Zh,0  I  vf) 


ojZg  I  vf) 

cr(0*  |  vf) 


ojZh  |  vf) 
O-(0*  I  vf)’ 


(5.4.201) 


(5.4.202) 


respectively.  After  substituting  from  (5.4.201)  and  (5.4.202)  into  (5.4.200),  it  is  known  that 
<r[Zg(v f),  Zft(vf)]  =  p{Zg,0  |  vf)  p(Zh,0  |  vf)  a(Zg  |  vf)  a (Zh  |  vf) 
where  division  of  (5.4.203)  by  the  product  cr(Zg  |  vf)  cr{Zh  |  vf)  yields 

2&W f). 4W1  ,  z  eu,,.a  ei 

<*Z,  |  vf)  <AZ„  |  vf ) 

One  then  finds  that  the  equality  on  the  left  in  (5.4.204)  is  p(ZgrZh  |  vf),  by  definition.  One  therefore  has 

p(Zg,Zh  I  vf)  =  p(Zg,0  I  vf)  p(Zh,6  I  vf)  (5.4.205) 

for  substitution  into  (5.4.196). 

After  squared  and  unsquared  substitution  from  (5.4.205)  into  (5.4.196),  one  obtains 


(5.4.203) 
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(5.4.206) 
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where  one  will  want  to  substitute  for  Z 3  j  vf)  and  cr(Z3  |  vf).  In  solving  the  first  two  equalities  in  (5.3.54) 

explicitly  for  a 2(Z3  |  vf ),  one  proceeds  by  transposition  to  obtain 

^(Zj  |  vf)  =  ^(Z,  |  vf)  [1  -  p2(Z2,Z3  I  vf)]  +  p2(Z2,Z3  I  vf)  ct2(Z3  |  vf),  (5.4.207) 


where  squared  substitution  from  (5.4.194)  into  (5.4.207)  leads  to 

o2(Z3  I  vf)  =  a2(Z3  I  vf)  j  1  +  p2(Z2,Z3  I  vf) 
which  may  be  rewritten  as 


o2(Z3  I  vf)  =  a2(Z3  I  vf)  U  +  p2(Z2,0  I  vf)  p2(Z3,0  |  vf) 


<fjZi  1  vf)  _ 

o2(Z2  I  vf) 

o2(Z2  I  vf) 


o2(Z2  I  vf) 


(5.4.208) 


(5.4.209) 


because  of  (5.4.205).  Squared  and  unsquared  substitution  from  (5.4.209)  into  (5.4.206)  now  allows  one  to  write 


where  placing  the  terms  in  the  first  braces  under  the  first  radical  to  the  right  of  the  equal  sign  over  a  common 
denominator,  subtracting  in  the  numerator  and  multiplying  the  resulting  expression  by  the  other  expression  in 


+ 


0-(0*  |  vf) 

p2(z2,o  |  vf)  p(z3,e  |  vf)  | 

<rl(Z2  |  vf) 
y(Z2  |  vf) 

V 
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_  1 

a2(Z2  |  vf) 

(5.4.211) 


In  (5.4.211)  there  are  four  occurrences  of  the  same  bracketed  expression.  As  a  result,  one  will  want  to  solve 
explicitly  for  this  expression  in  order  to  provide  further  simplification  in  (5.4.211)  through  substitution.  One 
begins  by  rearranging  the  first  two  equalities  in  (5.3,55)  to  obtain 


|  vf)  =  0^(0*  |  vf)  [1  —  p2(Z2,0  |  vf)]  +  p2(Z2,0  j  vf)  cr2(0*  |  vf)  , 


where  squared  substitution  from  (5.4.195)  into  (5.4.212)  allows  one  to  write 


0^(0*  |  vf)  =  0^(0*  |  vf) 


i  +  p1{Z2,e  |  vf) 


0^2  I  y*) 

cr^Zj  |  vf) 


Through  division  of  (5.4.213)  by  o-2)©*  |  vf),  one  obtains 


cr2)©*  |  vf) 
®2( O *  |  vf) 


=  1  +  P2(Z2,0  I  vf) 


(r\Zi  1  v*) 

<j2(Z2  |  vf) 
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(5.4.212) 


(5.4.213) 


(5.4.214) 


where  an  explicit  solution  for  the  bracketed  expression  yields 
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(5.4.215) 


I  v?) 

o2{Z2  |  vf) 
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P2(Z2,0  |  vf) 


0^(0*  |  vf) 
0^(0*  |  vf) 


the  sought  solution.  After  the  four  substitutions  from  (5.4.215)  into  (5.4.211),  the  cancellation  of  several  terms 
and  subsequent  multiplications  lead  to 


p(z3,0  |  vf)  =  p(z3,e  | 


p(z3,e  |  vf) 


o~( 0*  |  vf)  cr(0*  |  vf) 
cr(0*  |  vf)  <x(0*  |  vf) 


1  +  p2(Z3,0  I  vf) 


0^(0*  |  vf) 
o-2(0*  |  vf) 


-  1 


(5.4.216) 


where  the  numerator  under  the  first  radical  on  the  right  side  of  the  equal  sign  in  (5.4.216)  can  be  removed  from 
under  the  radical  after  subtraction.  One  then  has 


p(Z3,0  |  vf) 


P(Z3,0 


vf) 


<r(0*  |  vf) 
cr(0*  |  vf) 
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c t2(0 *  |  vf) 
0^(0*  |  vf) 
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cr(0*  |  vf) 
<r(0*  |  vf) 


cr( 0*  |  vf) 
<7(0*  |  Vf) 


1  +  P2(Z3,0 


vf) 


<72(  0*  |  Vf) 
<72(0*  I  Vf) 


(5.4.217) 


where  the  denominators  on  the  right  side  of  the  equality  are  identical,  thus  permitting  the  addition  of  the 
numerators.  After  multiplying  through  the  brackets  on  the  second  numerator  on  the  right  side  of  the  equal  sign 
in  (5.4.217),  the  addition  of  the  numerators  yields 


P(Z3,0  |  vf)  = 


p(Z3,0  |  vf) 


<7(0*  |  Vf) 
cr(0*  |  vf) 


1  +  p2(Z3,0  |  vf) 


0^(0*  |  vf) 
0^(0*  I  vf) 


(5.4.218) 


where  the  item  associated  with  Z3(vf),  as  it  will  be  aliased,  was  also  eligible  to  be  chosen  as  the  second  item 
in  the  tailored  test.  The  correlation  of  this  Zg{v f)  with  0*(vf)  for  that  ordering  is  given  by  (5.4.40).  Thus, 
unsquared  and  squared  substitutions  from  (5.4.40)  into  (5.4.218),  while  changing  the  aliased  subscript  from  2 
to  3,  allow  one  to  write 


p(Z3,0  I  vf) 


af  <r(0*  |  vf) 

V  1  +  [a$  cr(0*  |  vf)]2 


[g|  <x(0*  [  vf)]2  -  [af  cr(0*  |  vf)]2 

1  +  [af  cr(0*  |  vf)]2 


(5.4.219) 


After  placing  the  expression  under  the  radical  in  the  lower  denominator  of  (5.4.219)  on  a  common  denominator, 
the  subtraction  of  terms  provides 
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(5.4.220) 


af  cr(0*  |  vf) 


p(Z3,0|  vf)  = 


\  1  +  [af  cr( 0*  vf)]2 

/l  +  faf  cr(0*  |  vf)]2 
\  1  +  faf  cr( 0*  |  vf)]2 


where  multiplication  of  the  numerator  and  denominator  by  their  common  denominator  yields  the  result 

af  cr (0*  |  vf) 


p(Z3,0  |  vf)  = 


V  1  +  [af  cr(0*  |  vf )]2 


By  definition,  one  has 


p(Z3,0  |  vf)  = 


^3  O'?) 


\  1  +  [a3(vf)]2 


(5.4.221) 


(5.4.222) 


where  a3(v?)  is  appropriate  for  0*(vf)  or  0*(v*)  after  its  standardization  to  a  mean  of  zero  and  variance  of 
unity.  Upon  squaring  (5.4.222),  one  obtains 

'**•»!'*>- 7? ft  <5A223) 

where  substitution  from  the  squared  result  of  (5.4.221),  after  transposition,  provides 

[^(vf)]2  =  Iff  ft*  |  vf)]2  (5.4.224) 

1  +  [a3(vf  )]2  1  +  [af  cr(0*  |  vf))2 

Upon  clearing  the  denominators  in  (5.4.224),  one  obtains 

[a3(vf )]2  +  [a3(vf)]2  [of  cr(0*  |  vf)]2  =  [af  cr(0*  |  vf)]2  +  [a3(vf)]2  [af  <7(0*  |  vf)]2,  (5.4.225) 

where  subtraction  of  the  common  expressions  on  both  sides  of  the  equality  yields 

[#3(vf )] 2  =  [af  cr( 0*  |  vf)]2.  (5.4.226) 

Taking  the  square  root  of  (5.4.226),  one  has 

d3(vf)  =  af  cr( 0*  |  vf),  (5.4.227) 

indicating  that  a3(vf ),  appropriate  for  0*(vf )  or  0*(vf )  after  its  standardization  to  a  mean  of  zero  and  a  variance 
of  unity,  is  obtained  by  the  multiplication  of  two  knowns,  a%  and  cr(0*  |  vf).  Thus  (5.4.221)  provides  a 
convenient  expression  for  p(Z3,0  |  vf),  which  was  one  of  the  sought  solutions. 


V 


* 

2’ 


The  Point  of  Dichotomization  on  Standardized  Z3  Given  the  Outcome  Vector 

y3(V2) 


The  other  solution  one  now  seeks  is  a  convenient  expression  for  y3(vf ),  the  point  of  dichotomization  on 
Z3(vf )  or,  synonomously,  Z3(vf )  after  its  standardization  to  a  mean  of  zero  and  a  variance  of  unity.  In  obtaining 
this  solution  the  rescaling  of  0*  for  which  the  parameter  a3(vf)  is  appropriate  will  be  defined.  This  definition 
will  lead  to  a  solution  for  b3(vf).  For  completeness,  c3(vf)  will  then  be  defined.  At  this  juncture,  both 
p(Z3,0  |  vf)  and  Z?3(v f)  will  be  known.  Consequently,  y3(vf)  will  be  known,  because  y3(vf)  is  by  definition 
merely  the  product  of  p(Z3,0  |  vf)  and  b3(v f).  After  obtaining  this  solution  the  important  property  of  invariance 
will  be  further  considered. 

After  incidental  selections  on  0*  due  to  explicit  selections  on  Z,  and  Z2(vf ),  0*  can  be  standardized  to 
a  mean  of  zero  and  variance  of  unity.  This  standardization  is  accomplished  in  the  usual  manner  through 


0*(vf) 


d*  -  p(0*  I  vf) 
<7(0*  |  Vf) 


(5.4.228) 
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where  0*(v f)  is  a  realization  of  the  continuous  random  variable  0*(vf)  for  which  the  parameter  a3(v|)  is 
appropriate.  The  appropriate  parameter  b3{v% )  is  obtained  through 


b3(v f)  = 


bf  ~  I  vf) 

<t{0*  |  vf) 


(5.4.229) 


where  the  expression  on  the  right  side  of  the  equality  resembles  the  similarly  positioned  expression  in  (5.4.228). 
This  resemblance  occurs  because,  consistent  with  the  definition  of  the  difficulty  parameter,  fc3(vf)  is  rendered 
in  the  standard  scale  of  ability,  in  this  case  that  of  0*(vf).  The  parameters  a3(vf)  and  b3(vf)  are,  as  usual, 
defined  identically  in  both  submodels.  For  the  three-parameter  normal  ogive  submodel,  one  has 

c3(v'2)  =  cf  =  c3.  (5.4.230) 

Again  as  in  the  case  of  (3.3.65)  and  (5.4.49),  this  is  because  a  change  in  the  scale  of  ability  leaves  the  lower 
asymptote  of  the  regression  of  tne  binary,  multiple-choice  item  on  ability  unchanged. 

Since  y3(vf),  the  point  of  dichotomization  on  Z3(v f),  is  by  definition 


ysiv})  =  P(Z3,0  |  vf)  b3(v f),  (5.4.231) 

substitutions  from  (5.4.221)  and  (5.4.229)  into  (5.4.231),  along  with  a  cancellation  of  terms  and  divisions  of 
the  numerator  and  denominator  by  af ,  now  yield 


y3  (vf) 


b$  -  p\6*_  |  vf) 

[(af)~2  +  or2) O*  |  vf )]  5 ’ 


(5.4.232) 


the  sought  solution.  In  (5.4.232)  one  has  a  convenient  expression  for  the  point  of  dichotomization  on  Z3(vf ) 
where  the  required  inputs  are  known 


The  Property  of  Invariance 

Remember  that  the  property  of  invariance  pertains  to  the  probability  of  passing  item  g.  This  probability 
must  remain  invariant  for  any  particular  level,  rather  than  for  any  particular  numerical  value,  of  ability  under 
changes  in  the  scale  of  ability.  Invariance  is  obtained  by  simple  transformations  of  the  item  parameters  ag  and 
bg  given  a  change  in  the  scale  of  ability.  Earlier,  the  property  of  invariance  given  an  arbitrary  prescription  for 
the  scale  of  ability  was  discussed  in  connection  with  (2.3.122).  Again,  in  conjunction  with  (5.4.52),  the  property 
of  invariance  was  discussed  with  respect  to  a  change  in  the  scale  of  ability  resulting  from  the  standardization  of 
O*  subsequent  to  the  incidental  selection  on  6*  imposed  by  explicit  selection  on  Z, .  Here  the  discussion  will 
be  extended  to  include  a  change  in  the  scale  of  ability  resulting  from  the  standardization  of  O *  subsequent  to 
the  incidental  selections  on  G*  imposed  by  explicit  selections  on  Z,  and  Z2(vf).  Extending  equation  (2.3.122), 
invariance  requires  the  result 


ri(0)  =  y3(0*)  =  y3[0*(vf)]  (5.4.233) 

where  the  third  item  is  potentially  any  one  of  the  remaining  (p-  2)  unused  items  in  the  ability  bank.  The  point 
of  dichotomization  y3(vf)  would  be  the  lower  limit  of  integration  for  the  standardized  conditional  distribution 
of  Z3(vf)  given  0  (v2),  where  the  integral  yields  the  probability  of  producing  or  recognizing  a  correct  answer 
to  the  third  item  in  the  tailored  test  for  a  specific  numerical  value  of  6>*(vf ).  In  this  context,  y3[0*(vf )]  operates 
as  did  y3(0)  in  the  context  of  (2. 1.15).  When  the  level  of  ability  is  arbitrarily  fixed,  y3[0*(vf )]  must  equal  y3(0) 
even  though  the  particular  numerical  values  of  0*(vf )  and  O  are  unequal  because  of  intervening  transformations 
on  the  scale  of  ability.  Thus  the  probabilities  yielding  the  item  characteristic  curve  remain  undisturbed  when  the 
equality  in  (5.4.233)  is  maintained.  Given  invariance,  y3[0*(vf)]  will  be  defined  by 

y3[0*(vf)]  =  -  a3(vf)  [<)*(vf)  -  b3(v f)]  (5.4.234) 

under  the  necessary  condition  of  equality  asserted  in  (5.4.233).  Substitutions  from  (2.1.15),  (2.3  121)  and 
(5.4.234)  into  (5.4.233)  yield 

-  a3(d  -  b3)  =  -  a$(6*  -  bf)  =  -  a3(v2*)[0*(v2*)  -  fc3(v2*)]  (5.4.235) 
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where  substitutions  from  (5.4.227),  (5.4.228),  and  (5.4.229)  into  the  rightmost  member  in  the  equality  allows 
one  to  write 

-  a3(0  -  b3)  =  -  oj(0*  -6?)=-  aU&*  -  bf).  (5.4.236) 

Subsequent  substitutions  from  (2.3.118),  (2.3.119),  and  (2.3.120)  into  (5.4.236)  provide 

-  a3(0  -  h3)  =  -  a3(0  -  b3)  =  -  a3(0  -  b3)  (5.4.237) 

in  proof  of  both  the  necessary  condition  which  demonstrates  the  property  of  invariance  and  the  appropriateness 
of  the  parameters  a3(vj)  and  03(vf)  for  the  continuous  variable  of  transformed  ability  0*(vf ). 
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6.  THE  TAILORED  TESTING  ALGORITHMS  IN 

RECURSIVE  FORM 


6.1  Some  Preliminary  Recursive  Relationships 


In  developing  the  recursive  formulation  for  the  tailored  testing  algorithms  it  will  be  helpful  to  make  use 
of  a  few  conventions  in  notation.  Through  the  application  of  these  conventions  succinct  statements  can  be  derived 
which  summarize  the  major  results  of  previous  developments  as  well  as  provide  important  recurring  relationships. 
For  instance,  the  generalized  outcome  vector,  v*_,,  was  first  defined  in  Section  5.2.  This  vector  is  defined  as 
containing  the  binary  scores  for  the  answers  to  the  (« —  1)  previously  chosen  items  along  with  their  original 
subscripts  within  the  ability  bank.  In  this  context,  the  entry  for  v*_(  when  n  equals  one  represents  the  condition 
at  the  start  of  testing.  Thus,  the  generalized  outcome  vg  is  a  null  entry,  implied  but  absent  until  now.  Under 
this  convention,  a,(vg)  is  identically  a,,  appropriate  for  ability  0*,  or  merely  0,  that  is,  0*  in  standard  score 
form.  This  parameter  is_ defined  by  (2.2.19)  when  g  is  aliased  to  1  for  the  first  chosen  item,  g(l).  Accordingly, 
a2(v*)>  appropriate  for  0*(vf),  is  defined  in  (5.3.47);  and  a3(vf),  appropriate  for  0*(vf ),  is  defined  in  (5.3.112). 
In  general,  then,  one  will  find  that  a„(v*  i),  appropriate  for  0*(v*_j),  can  be  written  compactly  as 

an(v*~ i)  =  a*  cr( 0*  |  v*_,)  forn  =  1,  2,  ...  q,  (6.1.1) 

where  it  is  to  be  noted  that  cr(0*  |  vg)  is,  by  convention,  merely  cr(0*)  and  qt  is  the  number  of  items  in  the 
tailored  test  for  individual  i.  The  reader  may  now  review  this  recursive  phenomenon  through  consulting  (2.2. 19), 
(5.3.47),  and  (5.3.112).  Under  the  convention  of  generalized  notation,  one  has 


a„(v*_,)  =  a„(v„_,)  =  ,)  (6.1.2) 

which  is  to  say  that  this  parameter  is  defined  identically  under  both  submodels. 

In  similar  fashion,  b,(v g),  appropriate  for  0*  or  merely  0,  that  is,  0*  in  standard  score  form,  is  identically 
bu  as  defined  by  (2.2.20),  when  g  is  aliased  to  1  for  the  first  chosen  item,  g(1).  Accordingly,  b2(y f),  appropriate 
for  0*(vf),  is  defined  by  (5.3.49);  and  b3(vf ),  appropriate  for  0*(vf ),  is  defined  by  (5.3. 1 14).  In  general,  then, 
one  will  find  that  &„(vi?-i)  can  be  written  compactly  as 


bn(v*- ,)  = 


b*  ~  1  v*-i) 

o-(0*  |  v*_,) 


for  n  =  1,2,  ...  qt 


(6.1.3) 


where  it  is  to  be  noted  that  ^t(0*  vg)  is,  by  convention,  merely  /jl( 0*).  The  reader  may  now  review  this 
recursive  phenomenon  through  consulting  (2.2.20),  (5.3.49),  and  (5.3. 1 14).  Under  the  convention  of  generalized 
notation,  one  has,  then, 


b„(v*-i)  =  b„(vn_  |)  =  f?n(v'_i)  (6.1.4) 

which  is  to  say  that  this  parameter  is  defined  identically  under  both  submodels. 

Under  these  conventions,  the  parameter  c„(vg_ j)  can  be  defined  for  the  two-parameter  normal  ogive 
submodel 


c«0'«-i)  =  0  for  /i  =  1,  2,  ...  qt  (6.1.5) 

where  this  parameter  is  of  no  consequence  in  the  formulation.  Viewed  from  this  perspective,  one  finds  that  the 
two-parameter  submodel  results  when  cg  is  set  equal  to  zero  for  all  g  in  the  three-parameter  submodel  or  when, 
in  statistical  terminology,  the  three-parameter  submodel  is  degenerate  in  the  parameter  cg.  Later  this  relationship 
will  be  used  to  derive  the  tailored  testing  algorithm  for  the  two-parameter  submodel  from  that  of  the  three- 
parameter  submodel  by  simply  setting  cg  equal  to  zero  for  all  g.  In  the  three-parameter  normal  ogive  submodel, 
one  has 
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C„(v'_ ,)  =  c*  =  c„  for  n  =  1,  2,  ...  <?,  (6.1.6) 

as  can  be  verified  through  consulting  (3.2. 14)— with  n  aliased  to  1  for  the  first  chosen  item,  g(1) — (5.3.51),  and 
(5.3.116). 

Under  the  conventions,  the  correlation  between  Zn(v*_,)  and  0*(v*_,)  is  defined  by 


p(Zn,0 


<-i)  = 


fl*  cr(  0*  |  V*_i) 

{1  +  la*  a(6*  |  v*_i)]2}'5 


for  n  =  1,2,...  qh 


(6.1.7) 


where  this  recursive  relationship  can  be  confirmed  through  a  review  of  (2.2.21)— with  n  aliased  to  1  for  the 
first  chosen  item,  g(1> — (5.3.48),  and  (5.3.113).  One  then  has 

p(Z„,0  |  v*_,)  =  p(Zn,0  |  v„_,)  =  p(Z„,6  |  v'_,);  (6.1.8) 


which  is  to  say  that  this  correlation  is  defined  identically  under  both  submodels. 

Under  the  conventions,  y„(v*_1),  the  point  of  dichotomization  on  Z„(v*_,),  is  defined  by 


y«(>'?-i)  = 


b*  -  ti(0* 


v?-i) 


[(a*y 2  +  ^(6*  |  v*_  j )] 


for  n  =  1,2,...  q„ 


(6.1.9) 


which  in  recursion  summarizes  (2.2.22) — when  n  is  aliased  to  1  for  the  first  chosen  item,  gw — (5.3.50),  and 
(5.3.115).  One  has 

-y„(v*_ ,)  =  y„(v„_|)  =  y„(v,',-i)  (6.1.10) 


indicating  that  the  point  of  dichotomization  is  defined  identically  under  both  submodels.  The  density  in  the 
standard  normal  distribution  at  -y„(v*  _  |),  4>[y„(vi?-i)]>  is  by  definition 

4>[y, „(v*_ ,)]  =  (2tt)_-5  exp{-.5  (y„(v*_,)]2}  for  n  =  1,  2,  ...  <?,-  (6.1.11) 


where 

<My„(v*-i)]  =  <f>ly„(vn-\)]  =  <My„(v, Ui)]  (6.1.12) 

because  of  (6. 1  10). 

The  probability  of  a  correct  answer  to  the  nth  item  in  generalized  notation  may  be  written  as 

P*(v*_,)  =  C„(v*_,)  +  [1  -  C„(v*_,)]  ^>[-y„(v*_,)]  for  n  =  1,  2,  ...  (6.1.13) 

A  substitution  from  (6.1.6)  into  (6.1.13)  to  obtain  submodel  specificity  allows  one  to  write 

PM,- 1)  =  c„  +  (1  -  c„)  'Pl-yM-i))  for«  =  2>  •••  <7/  (6.1.14) 

for  the  three-parameter  case.  In  recursion  (6.1.14)  now  summarizes  (3.2.1)  when  n  is  aliased  to  1  for  the  first 
selected  item  g°\  and  (5.3.59).  For  the  two-parameter  normal  ogive  submodel,  one  merely  substitutes  from 
(6.1.5)  into  (6.1.13),  while  deleting  the  primes,  to  obtain 

=  (p[-y „(V„  _ ,)]  forn  =  1,  2,  ...  q,  (6.1.15) 

which  in  recursion  summarizes  (2.2.1) — when  n  is  aliased  to  1  for  the  first  chosen  item,  gm — and  (5.3.57). 

Notice  that  the  deletion  of  the  prime  on  v/,_,  in  obtaining  (6.1.15)  merely  changes  the  interpretation  of 
this  probability  from  that  of  recognizing  the  correct  alternative  to  a  multiple-choice  item  to  that  of  producing  a 
correct  answer  to  a  free-response  item.  Thus  one  may  write 

TV^-i)  =  ^[-ynK-i)l  for  n  =  1,2,  ...  q,  (6.1.16) 

for  the  probability  of  recognizing  the  correct  alternative  given  the  three-parameter  normal  ogive  submodel. 

In  generalized  notation,  the  probability  of  an  incorrect  answer  to  the  mh  item  may  be  written  as 

e*(v*_,)  =  [l  -  C„(v*_ ,)]  #[y„(v£-i)]  for  n  =  1,  2,  ...  qt.  (6  1.17) 

A  substitution  from  (6.1.6)  into  (6.1.17)  to  obtain  submodel  specificity  allows  one  to  write 

2,X-i)  =  (1  -  c„)  <£[y„(v;,-i)]  forn  =  1,  2,  ...  q,  (6.1.18) 
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for  the  three-parameter  case.  In  recursion,  (6.1.18)  now  summarizes  (3.2.2)  when  n  is  aliased  to  1  for  the  first 
chosen  item  g(l),  and  (5.3.60).  As  observed  in  connection  with  (5.3.65),  one  has 

Qn(v'n- 1)  =  <2>[y2K-i)]  for  n  =  1,2,  ...  <7,  (6.1.19) 

where  this  probability  represents  that  of  not  recognizing  the  correct  alternative  as  opposed  to  that  of  obtaining 
an  incorrect  answer  to  the  nth  item.  Because  of  (6. 1 . 10),  this  probability  is  equal  to  that  given  by 

Qn(v„- 1)  =  ^[y„(v„_i)]  (6.1.20) 

which  derives  from  rendering  (6. 117)  submodel  specific  through  a  substitution  from  (6. 1 .5)  while  deleting  the 
primes.  In  (6. 1.20),  one  has  the  probability  of  producing  an  incorrect  answer  to  the  nth  item  for  the  two-parameter 
case.  While  (6.1.19)  and  (6.1  20)  produce  equal  probabilities,  their  interpretations  under  each  submodel  are 
quite  different. 

Equations  (6.1.13)  through  (6.1.20)  contain  an  expression  in  common.  This  expression  is  <£>[*],  which 
is  by  definition  the  cumulative  normal  distribution  function  or  area  under  the  standard  normal  curve  given  specific 
limits  of  integration  from  negative  infinity  to  the  generalized  argument  denoted  by  the  asterisk. 


6.2  The  Tailored  Testing  Algorithm  for  the  Three-Parameter  Normal 
Ogive  Submodel 


When  one  begins  testing  an  individual,  it  is  known  that  the  individual  is  a  member  of  the  population  of 
interest.  Nothing  else  is  assumed  to  be  known  about  this  individual.  In  this  uninformed  state,  the  mean  of  ability 
in  the  population  of  interest,  p{0*),  is  taken  as  the  prior  estimate  of  this  individual’s  ability.  Accordingly,  the 
variance  or  squared  error  of  this  estimate  is  <^(0*),  the  variance  or  the  squared  standard  deviation  of  ability  in 
the  population  of  interest.  At  this  point,  the  parameters  a*,  b* ,  and  c*  are  known  for  each  item  in  the  ability 
bank.  As  the  nth  item  in  this  individual’s  tailored  test,  that  item  g  is  chosen  for  which 


r  a2  (0*  I  U ')  =  a2(0*  I  v;,_|) 


p2(z.,,0 |  v,;_,)  (i 


{0[y^(v;,-i)]}2 

W-,)  QM- ,) 


for  all  g  where  g  ^  g(0),  g(1),  ...  g('7-1)  (6.2.1) 

provides  the  minimum  value  over  the  (p  -  n  +  1 )  unused  items  in  the  ability  bank.  Notice  that  g(0>,  by  convention, 
places  no  restriction  on  the  choice  of  g<">  where  n  =  1,2 ,  q,.  The  nth  chosen  item  is  presented  to  the 

individual.  One  of  two  outcomes  is  possible.  This  individual’s  answer  can  be  correct  or  incorrect.  If  the  answer 
to  Item  n  is  correct,  the  revised  or  updated  estimate  of  the  individual’s  ability  is  given  by 


p(0*  |  v:.,X  =  1)  =  p{0*  |  <_,)  +  p(Z„ , 0  |  i/_,)  <r(0*  |  <_,)  (1  -  c„) 


P>'n- ,)  ’ 


(6.2.2) 


and  the  variance  of  this  revised  or  updated  estimate  of  ability  is  provided  by 
cr2(0*  |  v,', =  1) 


=  0^(0* 


v'_,)  I  -  p2(Z„,0 1 


0 


£«)  </>[y„(y,'i ~i)]  jo 

P'nW-l)  1 


£n)  0[y„(W,  -  I  )] 

W-i) 


(6.2.3) 

If  the  answer  to  Item  n  is  incorrect,  the  revised  or  updated  estimate  of  the  individual’s  ability  is  given  by 


MO*  |  =  o)  =  p.(0* 


W,-i)  -  p(Z„,0  I  v ' _ , )  cr(0* 


v'_.) 


</>[y„(v;,-i)] 

Q„(K-0 


(6.2.4) 


and  the  variance  of  this  revised  or  updated  estimate  of  ability  is  provided  by 
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o*( 0 *  I  W.-1X  =  0) 


0^(0*  |  v;,_ ,) 


p2{zn,e  |  v'_i) 


1)] 

Qn(K-i) 


1  Q„(K-\) 


r«(W,-i) 


(6.2.5) 


Given  either  outcome,  if  the  error  of  the  estimate,  cr (0*  |  v’„),  is  equal  to  or  less  than  the  prescribed  terminal 
error,  e, 

cr(0*  |  v')  e,  (6.2.6) 

the  testing  is  terminated.  Otherwise  the  next  item  n  is  chosen,  and  the  scenario  as  outlined  for  (6.2.1)  through 
(6.2.6)  is  continued  until  the  condition  imposed  by  (6.2.6)  is  satisfied.  The  item  satisfying  this  condition  is  by 
definition  Item  q,.  In  application  the  terminal  error,  e,  is  prescribed  by  the  practitioner.  This  prescription  entails 
considerations  that  are  presented  later  in  Chapter  7. 

In  proof  of  (6.2.1)  through  (6.2.6),  it  should  be  noted  that  the  recursive  formulation  of  this  algorithm 
merely  represents  a  summarization  and  extension  of  previous  results.  With  respect  to  previous  results:  in  choosina 
the  item,  (6.2.1)  summarizes  (5.3.30)  and  (5.3.91);  in  estimating  ability  given  a  correct  answer,  (6.2.2)  sum¬ 
marizes  (5.3.39)  and  (5.3.104);  in  estimating  the  variance  of  ability  given  a  correct  answer,  (6.2.3)  summarizes 
(5.3.45)  and  (5.3.109),  in  estimating  ability  given  an  incorrect  answer,  (6.2.4)  summarizes  (5.3.41)  and  (5.3. 105); 

and  in  estimating  the  variance  of  ability  given  an  incorrect  answer,  (6.2.5)  summarizes  (5.3.46)  and  (5.3. 1 10) _ 

for  the  first  two  items  in  the  tailored  test. 

Appropriate  substitutions  into  (6.2.1)  through  (6.2.5)  from  the  outputs  of  the  preliminary  recursive 
formulation  provided  in  Section  6. 1  must  be  made  in  evaluating  these  equations.  These  substitutions  render  the 
inputs  for  (6.2.1)  through  (6.2.5)  in  terms  of  known  values,  that  is,  the  mean,  the  variance,  and  the  item 
parameters.  The  density  function  of  the  standard  normal  distribution,  <£[*],  and  the  cumulative  normal  distribution 
function,  0[*],  can  then  be  evaluated. 

At  this  juncture  the  tailored  testing  algorithm  will  be  developed  for  the  two-parameter  normal  ogive 
submodel.  This  development  can  be  very  brief.  Given  the  tailored  testing  algorithm  presented  in  Equations 
(6.2.1)  through  (6.2.6),  it  is  only  necessary  to  assume  that  guessing  is  ineffective.  As  a  consequence,  cg  or  c„ 
is  zero  and  the  primes  can  be  deleted  on  all  terms.  This  simplifying  assumption  leads  to  the  algorithm  presented 
in  equations  (6.3.1)  through  (6.3.6).  It  will  then  be  verified  that  this  simplifying  assumption  yields  a  formulation 
that  summarizes  the  pertinent  earlier  results.  Under  the  two-parameter  normal  ogive  submodel,  the  scenario  for 
tailored  testing,  excluding  the  formulation,  proceeds  as  it  did  in  the  three-parameter  case. 


6.3.  The  Tailored  Testing  Algorithm  for  the  Two-Parameter  Normal 
Ogive  Submodel 


Again,  when  one  begins  testing  an  individual,  it  is  known  that  the  individual  is  a  member  of  the  population 
of  interest.  Nothing  else  is  assumed  to  be  known  about  this  individual.  In  this  uninformed  state,  the  mean  of 
ability  in  the  population  of  interest,  p.(0*),  is  taken  as  the  prior  estimate  of  this  individual’s  ability.  Accordingly, 
the  variance  or  squared  error  of  this  estimate  is  0^(0*),  the  variance  or  squared  standard  deviation  in  the 
population  of  interest.  At  this  point,  the  parameters  a*,  b* ,  and  c*  are  known  for  all  the  items  in  the  ability 
bank.  Since  this  submodel  is  degenerate  in  the  parameter  c|,  c*  is  known  to  be  zero  for  all  these  items.  As  the 
nth  item  in  this  individual’s  tailored  test,  that  item  g  is  chosen  for  which 


%Ug  0-2(0*  |  vn_uUg)  =  cr 2(0*  |  v„_,) 


1  -  p2(Z  ,0  |  v„_,) 


{0[^(v„-i)]}2  \ 


for  all  g  where  g  ¥=  g(0\  ga\  ...  (6.3.1) 

provides  the  minimum  value  over  the  (p-n+  1)  unused  items  in  the  ability  bank.  Notice  that  g<0>,  by  convention, 
places  no  restriction  on  the  choice  of  g<">  where  n  =  1,2,...  q,.  The  nth  chosen  item  is  presented  to  the 
individual.  One  of  two  outcomes  is  possible.  This  individual’s  answer  can  be  correct  or  incorrect.  If  the  answer 
to  Item  n  is  correct,  the  revised  or  updated  estimate  of  the  individual’s  ability  is  given  by 


M(0*  I  =  1)  =  p(0*  I  v„_,)  +  p(Zn,0  I  v„_,)  ar(0* 


v„-\) 


Pn(V„-  l) 


(6.3.2) 
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and  the  variance  of  this  revised  or  updated  estimate  of  ability  is  provided  by 

|  =  1) 


=  cr 2(6*  |  V„_,)  1  -  p2(Zn,0  I  V„_,) 


<f>ly„(V„-j)]  j  </>[%( V„_,)] 


-  7„(vn-i)  •  (6.3.3) 


Pn(v„-  i)  l  Pniyn- 1) 

If  the  answer  to  Item  n  is  incorrect,  the  revised  or  updated  estimate  of  the  individual’s  ability  is  given  by 


n(0*  I  =  0)  =  fx(0*  I  v„_,)  -  p(Z„,e  I  v„_,)  o(6*  I  v„ _ , ) 

and  the  variance  of  this  revised  or  updated  estimate  of  ability  is  provided  by 
o2(6*  |  =  0) 


Qn(V„-l) 


(6.3.4) 


=  o26*  |  v„  ,)  1  -  p2(Z„,6  |  v„_,) 


\  <t>[yn(v„-))] 


Q„(v„- 1)  l  Qn(v„- 1) 


+  %(vn-|) 


(6.3.5) 


Given  either  outcome,  if  the  error  of  the  estimate,  cr(0*  |  v„),  is  equal  to  or  less  than  the  prescribed  terminal 
error,  e, 


<r(0*  |  v„)  ^  e, 


(6.3.6) 


the  testing  is  terminated.  Otherwise,  the  next  item  n  is  chosen,  and  the  scenario  as  outlined  for  (6.3.1)  through 
(6.3.6)  is  continued  until  the  condition  imposed  by  (6.3.6)  is  satisfied.  The  item  satisfying  this  condition  is  by 
definition  Item  qh 

In  application,  the  terminal  error,  e ,  is  prescribed  by  the  practitioner.  This  prescription  entails  considerations 
that  are  presented  later  in  Chapter  7. 

In  deriving  (6.3.1)  through  (6.3.6)  from  (6.2.1)  through  (6.2.6),  it  is  necessary  merely  to  delete  the  primes 
on  all  terms  and  set  c g  or  cn  equal  to  zero.  For  instance,  the  cancellation  of  the  primes  on  Ph{Vn_x)  is  justified 
because  setting  cn  equal  to  zero  in  (6. 1 . 14)  yields  a  result  that  is  identical  to  that  given  for  P„(v„  _  j)  in  (6.1.15). 

In  proof  of  this  algorithm,  it  will  now  be  verified  that  (6.3.1)  through  (6.3.5)  summarize  the  previous 
results.  With  respect  to  previous  results:  in  choosing  the  item,  (6.3.1)  summarizes  (5.3.18)  and  (5.3.85);  in 
estimating  ability  given  a  correct  answer,  (6.3.2)  summarizes  (5.3.35)  and  (5.3. 102);  in  estimating  the  variance 
of  ability  given  a  correct  answer,  (6.3.3)  summarizes  (5.3.43)  and  (5.3.107);  in  estimating  ability  given  an 
incorrect  answer,  (6.3.4)  summarizes  (5.3.37)  and  (5.3.103);  and  in  estimating  the  variance  of  ability  given  an 
incorrect  answer,  (6.3.5)  summarizes  (5.3.44)  and  (5.3.108) — for  the  first  two  items  in  the  tailored  test. 

Appropriate  substitutions  into  (6.3.1)  through  (6.3.5)  from  the  outputs  of  the  preliminary  recursive 
formulation  provided  earlier  in  Section  6. 1  must  be  made  in  evaluating  these  equations.  These  substitutions  will 
render  the  required  inputs  for  (6.3.1)  through  (6.3.5)  in  terms  of  the  known  values,  that  is,  the  mean,  the 
variance,  and  the  item  parameters.  The  density  function  of  the  standard  normal  distribution,  </>[*],  and  the 
cumulative  normal  distribution  function,  <£[*],  can  then  be  evaluated. 


6.4.  A  Bayesian  Sequential  Algorithm 


A  Bayesian  sequential  procedure  for  adaptive  or  tailored  testing  was  published  earlier  by  Owen  (1975). 
In  this  publication  the  one-item  situation  was  considered.  The  selection  of  this  item  was  based  on  minimizing 

Kd.p.g)  =  V0  |l  -  (1  -  g)(l  +  V°'  (6A1) 

the  Bayesian  preposterior  risk.  Ability,  0,  in  this  context  was  assumed  to  be  distributed  normally  with  a  mean 
M0  and  variance  V0.  The  parameters  dh  and  g,  were  parameters  of  difficulty,  discriminating  power,  and 
guessing,  respectively.  The  functions  <f)(D)  and  <P(D)  were  those  of  the  standard  normal  distribution,  its  probability 
density  and  cumulative  distribution  functions,  respectively,  where  the  argument  D  was  given  as 


id  -  Mp) 

Vp  2  +  v0 


(6.4.2) 
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and  A  was  given  by 


A  =  g  +  0  -  g)  <H-D). 

The  estimator  of  ability  given  a  correct  answer  was  provided  as 

|  1)  =  M0  +  (1  -  g)  V0  (p~2  +  T0)-'5 

and  the  estimator  for  the  variance  of  ability  given  a  correct  answer  was  provided  as 

-2,,-u-i  wp)  r<L-  s)  <kd) 


Var(0|  1)  =  T0  jl  -  (1  -  g)(l  +  p~2V^) 

The  estimator  of  ability  given  an  incorrect  answer  was  provided  as 

*<0|O)  =  M0  -  V0(p- 2  +  Vo)--5~, 
and  the  estimator  of  the  variance  of  ability  given  an  incorrect  answer  was  provided  as 


-  D 


Var(0  |  0)  =  T0  \  1  -  (1  +  p-2  T0” ') 


4*D) 

<P(D) 


'<KD) 

<P(D) 


+  D 


(6.4.3) 


(6.4.4) 


(6.4.5) 


(6.4.6) 


(6.4.7) 


Because  this  formulation  was  recursive,  Owen  suggested  that  this  one-item  situation  be  repeated  until  V,„  the 
variance  of  ability  after  n  items,  was  acceptably  small 


6.5.  The  Comparison  of  Algorithms 

The  parameters ph  dh  and  g,  in  the  Owen  publication  correspond  to  a*,  b*,  and  c*  in  this  report.  Owen’s 
O,  assumed  to  be  normally  distributed  with  a  mean  M0,  and  variance  T0,  corresponds  to  0*  in  this  report,  which 
is  assumed  to  be  normally  distributed  with  a  mean,  pO*  \  v^),  and  variance  ^(O*  |  v').  Translating  Owen’s 
Z),  one  has 


D  _  frf  -  p(G*  |  Vq) 

[(afr2  +  a2(e*  I  V^)]-5  (6-5J) 

where  a  substitution  from  (6.1.9)  for  n  equal  to  one  into  (6.5.1)  yields 

D  =  7i(vo)-  (6.5.2) 

A  translation  of  Owen’s  A  of  (6.4.3),  along  with  substitutions  from  (6.1.6),  provides 


A  -  c,  +  (1  -  c,)  <P[  -  yi(Vo)]  (6.5.3) 

where  a  substitution  from  (6.1.14)  for  n  equal  to  one  into  (6.5.3)  yields 

A  =  PM  )l  (6.5.4) 

and  it  is  clear  after  a  substitution  from  (6.5.2)  into  <P(D)  that  one  has 

0(D)  =  0[y,(vi)]  =  Qt(v  o)  (6.5.5) 


because  of  (6. 1 .19)  when  n  equals  one.  Through  a  translation  of  terms  in  (6.4.1)  and  substitutions  from  (6.5.2), 
(6.5.4),  and  (6.5.5)  into  (6.4.1),  one  may  write  the  Bayesian  preposterior  risk  as 


Kb*,  a*,  c*)  =  cA(e*  K)  1  - 


_  {<fr[r*(v o)}2 
{1  +  [a*  a(0*  I  vi)]-2}  P'(v'0)  QJvq) 


(1  -  c*) 


for  the  first  selected  item  g(l)  where 

1 


_  =  [a*  o~( O*  |  Vq)]2 

{1  +  K  cr(0*  I  fo)]-2}  I  +  [a*  <j(0*  |  Vq)T 


=  p2(Zg,0  |  Vq), 


(6.5.6) 


(6.5.7) 
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because  of  (6.1.7)  and  (6.1.8)  when  n  equals  one.  Substituting  from  (6.1.6)  and  (6.5.7)  into  (6.5.6),  one  has 


Kb*,  a*,  c*)  =  cr2(0*  |  Vq)  I  1  -  p2(Zg,6  |  Vq)  (1  -  cg)  — — 


{4>[yM))}2 


p'M )  QM) 


(6.5.8) 


or,  because  of  (6.2. 1), 


l{b*,  a* ,  c*)  =  %ui  MO*  |  Vq,  U'f,), 


(6.5.9) 


the  minimum  value  provided  by  the  first  chosen  item  g(l).  Through  a  translation  of  terms  in  (6.4.4)  and  substitutions 
from  (6.5.2)  and  (6.5.4),  one  obtains 


«(0*  i  1)  =  1*9*  I  Vo)  + 


MM  1  Vq) 

[(af)-2  +  a2(G*  |  Vq)]  5 


(1  -  cf)  </>[yi(vp)] 

P'M) 


(6.5.10) 


where  multiplication  of  the  numerator  and  denominator  of  the  first  fraction  in  the  rightmost  term  in  (6.5.10)  by 
af ,  allows  one  to  write 


%(0*  I  1)  =  p(G*  I  v'0)  + 


Of  pjO*  |  Vq) 

{1  +  [af  (TiO*  |  v^)]2} 5 


0(0*  K)  (1  -  cf)  <Mvq)1 

P\(y 6) 


(6.5.11) 


One  can  now  substitute  from  (6.1.6)  and  (6.1.7),  for  n  equal  to  one,  into  (6.5.1 1)  to  obtain 


%(6*  |  1)  =  pKO*  |  v'Q)  +  p(Zx,6  |  Vq)  cr( G* 


Vo)  0  ~  c,) 


<f>ly,(vo)] 

P'M) 


(6.5.12) 


or 

%(6*  I  1)  =  Hie*  I  Vq,  u\  =  1),  (6.5.13) 

because  of  (6.2.2)  when  n  equals  one.  Through  a  translation  of  terms  in  (6.4.5)  and  substitutions  from  (6.5.2) 
and  (6.5.4)  into  (6.4.5),  one  may  write 

Var(0*  |  1) 


=  <r2(0*  |  Vq) 


_ 0  -  cf) _ </>[Yi(Vq)] 

{1  +  [af  a(0*  |  v^)]-2}  P’M) 


(1  -  cf)  d>[y,(Vo)] 
Pi  (vo) 


(6.5.14) 


where  substitutions  from  (6.1.6)  and  (6.5.7)  into  (6.5.14)  allow  one  to  write 
Var(  0*  |  1) 


=  a^iG*  |  Vq)  I  1  -  p2(Z],6  |  Vq) 


(1  -  C,)  t/>f ri(Vo)]  j(l  “  C|)  </>[Y|(Vq)] 


P'M) 


PM) 


(6.5.15) 


or  merely 


Var(0*  |  1)  =  a2(0*  |  Vq,  u\  =  1) 


(6.5.16) 


because  of  (6.2.3)  when  n  equals  one.  Through  a  translation  of  terms  in  (6.4.6)  and  substitutions  from  (6.5.2) 
and  (6.5.5)  into  (6.4.6),  one  obtains 


%(G*  |  0)  =  p(G*  |  v£)  - 


MM  I  vq)  d>[yi(vo)] 

[(af)-2  +  (^(G*  |  Vo)]  5  QM) 


(6.5.17) 


where  multiplication  of  the  numerator  and  denominator  of  the  first  fraction  in  the  rightmost  term  in  (6.5. 17)  by 
af ,  allows  one  to  write 


%(G*  |  0)  =  /l i(6*  |  v^)  - 


af  ojG*  I  Vq)  ojO*  I  Vq)  </>[yi(vp)] 

{1  4-  [af  ct(6*  |  Vq)]2}  5  e,(vo) 


(6.5.18) 
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(6.5.19) 


One  can  now  substitute  from  (6.1.7),  for  n  equal  to  one,  into  (6.5.18)  to  obtain 


«(0*  |  0)  =  ix(G * 


Vq)  -  p(Zt,0  |  Vo)  a(0*  |  Vq) 


</>[7i(Vq)] 

QM) 


or 


% (0*  |  0)  =  p(G*  |  vq,  u\  =  0) 


(6.5.20) 


because  of  (6.2.4)  when  n  equals  one.  Through  a  translation  of  terms  in  (6.4.7)  and  substitutions  from  (6.5.2) 
and  (6.5.5)  into  (6.4.7),  one  may  write 


Var(0*  |  0)  =  <r2(0*  |  Vq) 


_ j _ <fr[ri(Vo)]  f <M'yi(vo)] 

{1  +  [flf  <7(0*  |  Vq) ]  2}  0,(Vo)  {  Q,(v'0) 


+  TiO’o) 


where  a  substitution  from  (6.5.7)  into  (6.5.21)  leads  to 


Var( 0*  |  0)  =  0^(6*  |  Vq) 


<^[ri(^o)l  f 0[yi(vp)] 
G,(v  o)  1  Gi(vi) 


(6.5.21) 


(6.5.22) 


or  merely 


Var(0*  |  0)  =  0^(0*  |  Vq,  u[  =  0) 


(6.5.23) 


because  of  (6.2.5)  when  n  equals  one. 

In  the  developments  culminating  in  (6.5.9),  (6.5. 13),  (6.5.16),  (6.5.20),  and  (6.5.23),  it  has  been  proved 
that  the  tailored  testing  algorithm  for  the  three-parameter  normal  ogive  submodel  as  based  on  the  selection  or 
rejection  analogy  is  an  identity  of  the  Bayesian  sequential  algorithm  provided  by  Owen.  Since  both  algorithms 
are  recursive,  proof  of  identity  in  the  one-item  situation  is  sufficient,  Notice  also  that  the  simplifying  assumption 
that  guessing  is  ineffective  in  the  Bayesian  case  would  yield  an  algorithm  for  the  two-parameter  normal  ogive 
submodel.  This  recursive  algorithm  would  necessarily  be  an  identity  of  the  recursive  algorithm  provided  in 
Section  6.3  for  the  two-parameter  normal  ogive  submodel.  A  demonstration  of  submodel  degeneracy  under  this 
assumption  was  given  there. 

It  is  hoped  that  the  exposition  in  this  report  based  on  the  selection  or  rejection  analogy  has  improved  the 
accessibility  of  the  Owen  Bayesian  algorithm,  in  particular,  the  accessibility  for  psychometricians  who  are 
comfortable  with  selection  theory,  yet  unfamiliar  with  Bayesian  statistics  and  terminology. 
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7.  THE  RELIABILITY  OF  THE  TAILORED  TESTING 

PROCESS 


In  Chapter  4  it  was  mentioned  that  the  process  of  tailored  testing  produced  an  individualized  test  for  each 
examinee.  Algorithms  were  developed  for  this  process  in  Chapters  5  and  6.  This  individualized  process  will  be 
numerically  illustrated  in  Chapter  8.  In  Chapter  8  it  will  become  apparent  that  each  test  is  potentially  unique. 
Reliability,  of  necessity,  then  must  be  considered  a  property  of  the  results  of  the  process  rather  than  a  property 
of  a  specific  test  form.  This  aspect  of  tailored  testing  stands  in  sharp  contrast  with  conventional  pencil-and-paper 
testing  where  reliability  is  a  property  of  a  specific  printed  form.  In  this  chapter,  an  index  of  reliability  for  the 
results  of  the  process  of  tailored  testing  will  be  derived  from  selection  theory.  In  addition,  the  implications  of 
this  index  with  respect  to  the  control  of  the  process  will  be  enumerated;  and  further  features  of  this  formulation 
will  be  discussed. 

The  index  of  reliability  represents  a  binary  analogue  of  the  squared  multiple  correlation.  It  possesses  the 
following  similarities  with  reliability  in  classical  theory:  (a)  this  index  represents  the  correlation  between  equi- 
precise  estimates  of  the  same  ability  which  is  analogous  to  the  correlation  between  parallel  forms,  and  (b)  the 
square  root  of  this  index  represents  the  correlation  between  equiprecise  ability  estimates  and  true  ability,  which 
is  analogous  to  the  correlation  between  test  scores  and  true  score. 

7.1  The  Derivation  of  an  Index  of  Reliability  for  the  Tailored  Testing 
Process 


In  this  derivation  it  is  assumed  that  the  partial  variance  of  the  criterion  variable  0*(v$),  or  merely  0*, 
remains  unchanged  by  explicit  selections  on  the  partialled  variables  Z„  where  n  =  1,2,  ...  qr  This  assumption 
is  algebraically  expressed  in 

cr^e*  i  vj)  -  mr  x[zv§),zm i  m) 

=  <r2(0*  I  V*)  -  p(v*y  X[Z(v*),Z(v*)]  /3(V*),  (7.1.1) 

where  both  sides  of  the  equality  represent  partial  variances:  on  the  left,  that  of  0*(vg)  or  merely  O*  before  the 
ql  explicit  selections ,  and  on  the  right  that  of  0*(v*.)  after  the  q,  explicit  selections  on  the  continuous  variables 
Z„.  In  (7.1.1),  /3(vg)  is  a  vector  of  least  squares  partial  regression  coefficients  predicting  0*(v§)  from  the  Zn\ 
and  (iiv*  )  is  a  vector  of  least  squares  partial  regression  coefficients  predicting  0*(v*.)  from  the  Z„(v*.).  The 
variance-covariance  matrices,  l\Z(v%),  Z(vg)]  and  Z[Z(v*.),Z(v* )],  are  those  for  the  Z„(v§),  or  merely  the  Z„, 
before  the  explicit  selections,  and  the  Z„(v*,),  the  Z„  after  q ,  explicit  selections,  respectively.  The  matrix  operations 
on  the  right  side  of  both  equalities  in  (7.1.1)  yield  expressions  that  are  familiar  from  multiple  linear  regression. 
From  the  least  squares  apparatus  one  has 

P(v§)'  2[Z(v$),Z(v§)]  /3(vf)  =  (r2( 0 *  |  v$)  R}e*/.u/.,,  |  vy  (7.1.2) 


as  the  partialled  or  predicted  variance  in  0*(vg);  and  as  the  partialled  or  predicted  variance  in  0*(v* ),  one  has 


/8(v*)'  l[Z(v*),Z(i’*)\  (}(v*)  =  a2(G* 


Vq)  Rh*A ,Z2,  |  **•)■ 


(7.1.3) 


In  (7. 1 .2)  and  (7. 1 .3),  the  squared  multiple  correlations,  the  R2r),  are  those  before  and  after  the  explicit  selections, 
the  latter  squared  multiple  correlation  being  subject  to  restriction  in  range.  Substitutions  from  (7. 1 .2)  and  (7.1.3) 
into  (7.1.1),  along  with  some  rearrangement,  lead  to 


<x2( Of  |  v0*)  [1  -  R}e*  A.y,_.  ...xm  \  v*,]  =  \  v*)  [1  -  /?(Vz,.z2.  |  r*J, 


(7.1.4) 


a  form  that  is  reminiscent  of  (5.3.4)  and  (5.3.55).  A  solution  of  (7.1.4)  for  cj2( 0 *  \  v*),  the  restricted  variance 
of  ability  at  the  termination  of  the  tailored  test  for  individual  i,  yields 
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I 


(7.1.5) 


Cj2(Q*  |  V*)  =  0^(0*  |  vj)  [1  -  4.4Z!i  ,Xq,  |  „*)] 

+  ^(0*1  V*)  /?(W„z2,  .../„  I  vV 

where  the  last  term  on  the  right  in  this  equation  represents  the  predictable  variance  given  the  full  linear  regression 
of  0*  on  the  Zn  which  is  lost  through  estimating  ability  from  the  binary  outcomes  or  item  scores  This  term 
may  be  seen  to  decrease  in  value  as  the  number  of  items  in  the  test  increases.  An  increase  in  the  number  of 
items  increases  precision  or  reduces  cr(Q*  |  v*,);  and  continued  explicit  selections  on  the  Z„  result  in  a  more 
severe  restriction  in  range,  which  is  accompanied  by  a  reduction  in  the  squared  multiple  correlation, 
R(0*y.uy2.  ...xm  |  v*y  The  important  implication  here  is  that  with  properly  configured  ability  banks  the  full  power 
of  multiple  linear  regression  can  be  approximated  by  estimating  ability  from  binary  outcomes  or  item  scores. 
Notice  that  the  output  of  (7. 1 .5)  approaches,  as  n  increases,  the  squared  standard  error  of  estimate,  the  first  term 
on  the  right  side  of  (7.1.5),  because  the  numerical  value  of  the  last  term  on  the  right  side  of  (7.1.5)  becomes 
negligible. 

In  (7.1.5)  the  within-individual  variance  has  been  examined.  Knowledge  of  the  expected  value  of  this 
variance  over  individuals  will  allow  us  to  solve  for 


2  _  0^(0*  |  y$)  -  cr2(0*  |  y*) 

<x2(0*  I  v$) 


(7.1.6) 


because  (^(O*  |  vg)  is  known.  The  quantity  provided  by  (7.1.6)  is  commonly  known  as  the  correlation  ratio. 
In  this  context  it  indexes  a  curvilinear  relationship  unless  the  cr^O*  |  v*)  are  held  constant  across  individuals. 
When  the  tailoring  process  is  begun,  linearity  of  regressions  and  homoscedastic  partial  variances  are  assumed. 
If  the  process  terminates  with  homoscedastic  partial  variances,  the  regression  of  the  ability  estimates  will  be 
linear.  Termination  of  the  tailored  tests  while  satisfying  the  condition  of  equiprecision,  guarantees  homoscedastic 
partial  variances  about  the  linear  regression  of  the  ability  estimates.  There  is  something  novel  here.  An  ability 
estimate  is  a  point  on  the  line  of  regression  of  0*(vg),  or  merely  0*,  on  the  Z„  for  each  individual  i.  Equiprecision 
at  the  termination  of  testing  over  the  individuals  t,  where  i  =  1,2,  ...  (V,  renders  the  N  linear  regressions  collinear. 
The  ability  estimates  for  all  individuals  will  then  form  a  linear  regression.  Given  a  linear  regression,  one  has 


p2[0,p.(Q*  |  »*)] 


q-2(0*  I  vg)  ~  T,cr2(0*  |  y*)  _  cr2(0*  |  v$)  -  e2 
o-2(0*  I  vtf)  “  O-2(0*  I  V$) 


(7.1.7) 


as  the  squared  linear  correlation  between  the  6*  and  the  ability  estimates,  the  p(6*  |  y* ).  In  the  rightmost 
equality  of  (7.1.7),  the  constant  variance  at  the  termination  of  tailored  testing  replaces  the  expectation  in  the 
centered  equality,  because  the  expectation  of  a  constant  is  the  constant,  in  this  case  the  terminal  variance  e2. 
Equation  (7.1.7)  may  also  be  written  as 


p[p(0*  |  v*),pi(0* 


v*)]  = 


<t2(0*  I  iff)  -  e2 
<r2(0*  I  v$) 


(7.1.8) 


the  linear  correlation  between  distinct  ability  estimates,  the  p.(0*  |  v* ),  and  the  p.(6*  \  v*)  of  equiprecision. 
In  (7.1.7)  and  (7.1.8)  one  has  an  index  of  reliability  for  the  results  obtained  through  the  tailoring  process.  As 
n  increases  and  the  last  term  on  the  right  in  (7. 1.5)  vanishes,  one  then  has 


e2  =  %,  a 2(0*  |  vj)  [1  -  R\e-  y.„y2.  |  **>] 

=  ^(0*  |  v0*)  [1  -  .K(W„z,,  ...z„.  |  v*)]. 


because  the  expectation  of  a  constant  is  the  constant.  Upon  substituting  (7.1.9)  into  (7.1.7)  and  its  identity 
(7.1.8),  one  may  write 

p2(0,^,(0*  |  v*)]  =  p[p.(6*  |  v*),n(6*  |  v*)]  =  Rle*  y.i.y.1,  ...z„(  |  vy  (7.1.10) 

as  the  upper  bound  to  this  index  of  reliability  when  the  qh  or  the  q,  and  the  r,  are  increased  indefinitely.  This 
upper  bound  represents  the  squared  multiple  correlation,  constant  for  sets  of  Z„  over  individuals,  that  is  obtainable 
using  the  full  multiple  linear  regression  equation  for  the  regression  of  0*(v§),  or  merely  0*  on  the  <7,  or  the  r, 
Zn  for  all  individuals. 
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7.2.  The  Index  of  Reliability  and  Its  Implications  for  Practice 

The  terminal  variance  or  its  square  root  e,  the  terminal  error,  can  be  prescribed.  It  is  a  constant  in  the 
tailoring  process.  As  a  constant  in  the  process,  the  prescription  must  occur  in  advance,  because  e  is  as  applicable 
to  the  first  as  it  is  to  the  last  tailored  test.  The  variance  of  0*,  ^(0*  |  vg),  is  fixed  or  known  at  beginning  of 
the  tailoring  process.  Consequently,  a  prescribed  e  determines  the  outputs  of  (7.1.7)  and  (7.1.8),  the  reliability 
of  the  results  obtained  through  the  tailoring  process.  A  prescription  for  e  is,  therefore,  a  specification  for  the 
reliability  of  the  results  obtained  through  the  tailoring  process.  One  can  then  explicitly  solve  (7.1.7)  for  e  given 
a  desired  lower  limit  to  the  reliability  as 

e  =  0<e*  I  Vq  )  Vl  -  pWMO*  |  V*)]  (7.2.1) 

and  use  the  output  of  (7.2.1)  as  the  terminal  error  in  either  (6.2.6)  or  (6.3.6) — depending  on  the  submodel 
involved. 

In  practice,  tailored  tests  are  terminated  when  cr(0*  |  v*)  is  at  most  e  or  when 

cr(0*  |  v*)  ^  6  (7.2.2) 

first  obtains.  As  a  result,  the  outputs  of  (7.1.7)  and  (7.1.8)  represent  a  lower  bound  to  the  actual  reliability  of 
the  results  obtained  through  the  process.  The  error  in  estimating  ability  is  actually  less  than  that  used  in  obtaining 
the  lower  bound  to  the  reliability  as  given  by  (7.1.7)  and  (7.1.8).  The  actual  reliability  approaches  the  lower 
bound  as  e  becomes  more  stringent  because  the  item  to-item  decrement  in  <x(0*  |  v*)  becomes  less  and  less  as 
finite  n  in  the  tailored  test  increases.  Thus,  e  is  more  closely  approached  at  termination.  For  typical  ranges  of 
reliability,  say,  from  .8  and  greater,  actual  reliability  will  closely  approach  this  lower  bound. 

Notice  that  (7.1.7)  provides  a  population  parameter.  The  actual  correlation  between  0*  and  p (0*  |  v *) 
in  random  samples  from  the  population  of  interest  is  an  estimate  of  the  parameter  that  has  the  output  of  (7.1.7) 
as  its  lower  bound.  It  should  be  pointed  out  that  the  output  of  (7. 1 .7)  has  little  relevance  to  the  actual  correlation 
between  0*  and  pt(0*  |  v*.)  in  biased  samples  with  respect  to  the  population  of  interest.  This  situation,  of 
course,  points  out  the  critical  requirements  of  defining  the  population  of  interest  prior  to  parameter  estimation 
and  of  maintaining  that  definition  in  the  tailoring  situation. 

The  critical  requirements  of  accurate  estimates  for  the  item  parameters  and  of  an  ability  bank  with  a 
proper  configuration  of  item  parameters  were  discussed  earlier  in  Chapter  4.  These  critical  requirements  must 
be  met  in  order  to  effectively  practice  tailored  testing  as  advanced  in  this  report. 

In  the  empirical  study  alluded  to  earlier  (Urry,  1977),  the  actual  reliabilities,  after  taking  attenuation  in 
the  paper-and-pencil  test  into  account,  exceeded  the  lower  bounds  to  the  reliability  for  some  eight  levels  of  e. 
In  this  study,  these  lower  bounds  ranged  from  .70  to  .93.  This  particular  empirical  study,  therefore,  provides 
convincing  evidence  that  the  basic  assumptions  of  the  three-parameter  normal  ogive  submodel  and  the  tailoring 
algorithm  for  the  three-parameter  normal  ogive  submodel  can  be  reasonably  well  met  with  extant  multiple-choice 
items. 

There  are  several  desirable  consequences  ensuing  from  the  method  of  tailored  test  termination  described 
in  connection  with  (6.2.6)  and  (6.3.6).  These  consequences  should  be  noticed:  a  comprehensive  evaluation  of 
all  basic  assumptions  is  enabled;  process  reliability  is  rendered  controllable;  equiprecision  in  ability  estimation, 
an  essential  component  in  test  fairness,  is  monitored;  and  subsequent  applications  of  tailored  test  results  are 
rendered  more  tractable  because  linear  relationships  have  been  maintained. 

This  method  of  tailored  test  termination  can  be  extended  to  the  case  where  several  ability  estimates  are 
obtained  for  each  individual. These  several  estimates  are  derived  through  the  tailoring  of  several  tests  given  the 
items  from  each  of  several  well-conditioned  ability  banks.  This  extension  of  the  method,  its  basic  assumptions, 
and  its  practical  value  will  be  discussed  in  a  subsequent  report.  In  brief,  the  value  of  this  extended  method  resides 
in  providing  the  bases  for  the  emergence  of  tailored  testing  systems.  A  basis  is  provided  for:  the  communication 
of  users’  needs  to  the  tailored  testing  system;  and  the  monitoring  of  the  tailored  testing  system  with  respect  to 
how  well  these  needs  are  being  met.  In  other  words,  the  products  of  the  tailored  testing  system  can  be  defined; 
and  the  quality  of  these  products  can  be  monitored. 
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8.  A  NUMERICAL  ILLUSTRATION  OF  A  TAILORED 

TEST 


For  the  purpose  of  illustration,  the  tailored  testing  algorithm  for  the  three-parameter  normal  ogive  submodel 
will  be  used.  This  algorithm  is  currently  more  relevant  given  the  available  data  bases.  In  this  illustration,  the 
number  of  items  in  the  ability  bank  has  been  restricted  to  twenty.  This  restriction  would  be  unrealistic  in 
applications,  but  is  very  convenient  for  the  purpose  of  illustration.  It  also  reduces  the  computational  effort, 
making  the  mathematical  problem  more  manageable  for  those  who  might  wish  to  benefit  from  practice  with  the 
numerical  process.  As  a  further  unrealistic  but  convenient  restriction,  the  actual  text  of  the  items  in  the  ability 
bank  will  not  be  considered. 

8.1.  Initialization  of  the  Process 

Before  testing  can  begin,  the  item  parameters  for  the  p  items  in  the  ability  bank  must  be  known,  the  scale 
of  measurement  for  ability  must  be  prescribed,  and  a  terminal  error,  e,  must  be  determined.  In  practice,  the  item 
parameters  must  be  estimated.  The  item  parameters  appropriate  for  0  where  the  mean  of  0,  p,{0'),  and  the 
variance  of  0,  cr2{0),  are  zero  and  unity,  respectively,  have  been  estimated  in  a  large  data  set  where  the  numbers 
of  items  and  individuals  were  both  sizable.  The  number  of  items  for  the  ability  bank  was  subsequently  restricted 
to  twenty.  The  parameter  estimates  ag,  bg,  and  cg  are  presented  in  Table  8.1.1.  It  has  been  decided  that  the 
mean  of  the  ability  estimates  should  be  100  and  the  variance  of  these  estimates  should  be  400.  This  decision 
was  based  on  a  requirement  to  render  the  ability  estimates  in  a  familiar  scale  with  a  mean  of  100  and  a  standard 
deviation  of  20.  There  is  also  a  requirement  that  the  reliability  of  the  resulting  ability  estimates  be  .90.  This 
also  means  that  the  correlation  between  the  ability  estimates  and  true  ability  will  be  .95.  In  order  to  fulfill  the 
joint  requirements,  p(0*  |  Vq)  will  have  to  be  set  equal  to  100;  and  o2(0*  |  Vg)  will  have  to  be  set  equal  to 
444.4444.  The  estimates  of  ability  are  regressed  estimates,  thus  the  variance  of  0*  must  be  set  such  that 

crV(6>*  |  v;,)]  =  p2[0,p(0*  |  <)]  cr2(0*  I  vp  (8.1.1) 

where  o2[p(0*  |  v^.)]  is  the  desired  variance  of  the  estimates  of  ability  and  p2[0,p.(0*  |  v'q.)]  is  the  lower  bound 
to  the  reliability,  in  this  case  400  and  .90,  respectively  The  numerical  solution  for  the  required  cr2(0*  |  Vq)  is 
then  444.4444  where  the  standard  deviation,  of  0*  |  Vq),  is  21.0819.  The  appropriate  terminal  error,  e,  is  provided 
by  (7.2.1)  as  6.6667.  At  this  level  of  prescribed  reliability,  the  actual  reliability  of  the  ability  estimates  obtained 
through  the  tailoring  process  will  closely  approach  the  lower  bound  of  .90.  Thus,  the  obtained  mean  and  variance 
will  approach  the  desired  mean  and  standard  deviation  in  large  samples  from  the  population  of  interest.  A 
complete  discussion  of  tailored  testing  reliability  was  given  in  Chapter  7. 

At  this  juncture,  one  has  prescribed  p.{0*  |  Vq),  o2(0*  \  Vq),  and,  consequently,  o(0*  |  Vq).  Also,  e,  the 
terminal  error,  has  been  calculated.  The  parameters  a*,  b*,  and  c*  that  are  appropriate  given  the  prescription 
can  now  be  obtained.  The  use  of  the  conventional  notation  for  the  estimates,  that  is,  ag,  bg,  and  cg,  will  be 
discontinued.  In  doing  this  it  is  tacitly  assumed  that  the  estimates  of  the  parameters  presented  in  Table  8.1.1  are 
sufficiently  accurate  for  the  population  of  interest.  The  appropriate  parameters  are  presented  in  Table  8.1.2. 
These  parameters  are  obtained  through  the  invariance  transformations  given  in  (2.2.17),  (2.2.18),  and  (3.2.14) 
for  the  a*,  the  b*,  and  the  c*. 

8.2.  The  Testing  of  the  Individual 

As  the  testing  of  this  individual  is  begun,  it  is  known  that  the  individual  is  a  member  of  the  population 
of  interest.  Thus  the  prior,  least  squares  estimate  of  ability  is  p.(0 *  |  Vq)  or  100;  and  the  prior  estimate  of  the 
variance  of  this  ability  estimate,  0^(0*  |  Vq),  is  444.4444.  The  testing  of  this  individual  will  continue  until  the 
error  of  the  estimate  of  ability,  cr(0*  |  v^.),  becomes  equal  to  or  less  than  e  or  6.6667. 
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TABLE  8  1.1 


Estimated  Parameters  for  the  Items  in  the  Ability  Bank  Given  0  Where  p(0)  Equals  Zero  and 

ct2(0)  Equals  Unity 

Estimated  Parameters 

Item 

ax 

k 

CH 

0?) 

i 

1.96 

-1.92 

.16 

2 

2.36 

-1.71 

.23 

3 

1.88 

-  1.50 

.21 

4 

2.41 

-1.29 

.22 

5 

2.10 

-1.09 

.19 

6 

2.16 

-.92 

.17 

7 

2.06 

-.74 

.22 

8 

2.33 

-.49 

.15 

9 

1.85 

-.28 

16 

10 

2.61 

-.11 

.11 

11 

2.09 

.12 

.14 

12 

2.50 

.31 

.22 

13 

2.19 

.51 

.13 

14 

2.07 

.69 

.20 

15 

1.80 

.93 

.14 

16 

2.23 

1.08 

.21 

17 

1.82 

1.32 

.13 

18 

2.53 

1.53 

.20 

19 

1.97 

1.70 

16 

20 

2.28 

1.94 

.18 

p  =  20 


Item  1  can  now  be  chosen.  In  Table  8.2. 1  a  numerical  summary  is  presented  of  the  process  resulting  in 
the  choosing  of  Item  1 .  For  convenience  in  exposition,  the  numerical  summaries  for  the  choosing  of  each  of  the 
items  in  this  tailored  test  will  have  a  similar  structure.  For  purposes  of  clarity,  the  conventions  of  recursive 
notation  introduced  in  Section  6. 1  will  be  observed  in  these  numerical  summaries.  In  these  summaries  and  for 
columns  (2)  through  (1 1)  of  the  table,  the  equation  involved  in  producing  the  tabled  entries  will  be  identified. 
In  column  (1),  the  item’s  subscript  within  the  ability  bank  is  presented.  Columns  (2),  (3),  and  (4)  provide  the 
parameters  ag Oo),  bg{v'0),  and  cg  appropriate  for  standardized  0*(vq),  by  convention  0*(v q),  or  merely  0.  These 
parameters  are  obtained  from  (6. 1 . 1),  (6. 1 .3),  and  (6. 1 .6)  for  n  equal  to  1 .  The  required  inputs  for  these  equations 
are  a|,  b*,  and  c*  as  given  in  Table  (8.1.2),  and  /*(0*  |  v'Q)  and  cr(0*  |  Vq)  or  100  and  21.0819,  respectively. 
Within  the  rounding  error  introduced  in  Table  8.1.2,  these  parameters  are  identical  to  the  corresponding  estimates 
in  Table  8.1.1.  Sufficient  accuracy  has  been  assumed  for  these  estimates.  In  column  (5),  one  has  the  correlation 
between  Zg(v 6)  and  0*(vq),  or  merely  Zg  and  Q*,p(Zg,6  |  Vq),  as  provided  by  (6.1.7)  for  n  equal  to  1;  because 
each  item  in  the  ability  bank  is,  as  of  now,  potentially  Item  1 .  The  point  of  dichotomization  on  Zg(v q),  y  (vq), 
is  given  in  column  (6).  It  is  obtained  most  readily  by  the  row-wise  multiplication  of  columns  (3)  and  (5),  which, 
within  rounding  error,  results  in  the  identical  output  of  (6. 1 .9)  under  the  circumstance  that  Item  1  is  being  sought! 
The  density  in  the  standard  normal  distribution  at  yg(vo),  4>[yg(v q)],  is  presented  in  column  (7).  The  density  is 
obtained  from  (6.1.1 1).  The  probability  that  this  individual  will  recognize  the  correct  answer  to  multiple-choice 
item  g,  Pg(v o),  is  presented  in  column  (8)  and  is  obtained  from  (6.1.16)  under  the  circumstance  that  Item  1  is 
sought.  Column  (9)  contains  the  probability  that  this  individual  will  not  recognize  the  correct  alternative  to 
multiple-choice  item  g,  Qg(Vo).  This  probability  is  obtained  most  readily  as  the  row-wise  complement  of  column 
(8),  that  is,  [1  -  /^(Vq)],  which  is  identically  the  output  of  (6  1.19)  under  this  circumstance.  Column  (10) 
presents  the  probability  of  obtaining  a  correct  answer  to  multiple-choice  item  g,  P'g(v 'Q).  These  numerical  values 
are  obtained  from  (6.1.14)  for  n  equal  to  1  where  each  item  in  the  ability  bank  is  potentially  Item  1.  In  column 
(11)  one  has  the  expected  values  of  the  variance  of  the  ability  estimate,  %v.  a2) 0 *  |  v'0,U'g ),  given  the  possible 
outcomes  for  each  item.  Each  expected  value  is  obtained  from  (6.2.1)  using  0^(0*  |  Vq)  or  444.4444  and  the 
row-wise  entries  in  columns  (4),  (5),  (7),  (9),  and  (10)  as  inputs.  Given  the  entries  in  column  (11),  the  most 
informative  item  is  sought,  that  is,  the  item  which,  when  responded  to  by  this  individual,  is  expected  to  reduce 
most  the  variance  of  the  ability  estimate.  As  mentioned  earlier,  this  reduction  increases  the  precision  of  the 
ability  estimate  or,  analogously,  most  restricts,  in  expectation,  the  variance  of  ability  for  that  subpopulation 
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TABLE  8.1.2 

Parameters  for  the  Items  in  the  Ability  Bank  Given  0*  Where  (x(0*) 


and  cx2(0*)  Have  Been  Prescribed 


Parameters 


Item 

<*) 

Clo 

1 

.09297 

2 

.11194 

3 

.08918 

4 

.11432 

5 

.09961 

6 

.10246 

7 

.09771 

8 

.11052 

9 

.08775 

10 

.12380 

11 

.09914 

12 

.11859 

13 

.10388 

14 

.09819 

15 

.08538 

16 

.10578 

17 

.08633 

18 

.12001 

19 

.09345 

20 

.10815 

h* 

us 


59.5228 

.16 

63.9500 

.23 

68.3772 

.21 

72.8044 

.22 

77.0208 

.19 

80.6047 

.17 

84.3994 

.22 

89.6699 

.15 

94.0971 

.16 

97.6810 

.11 

102.5298 

.14 

106.5354 

.22 

110.7517 

.13 

114.5465 

.20 

119.6061 

.14 

122.7684 

.21 

127.8280 

.13 

132.2552 

.20 

135.8391 

.16 

140.8988 

.18 

Note.  fi(9*)  =  100.00;  <P(0*)  =  444.4444;  p  =  20. 


which  would  have  been  selected  or  rejected  had  explicit  selection  actually  occurred  on  the  continuous  variable 
Zj.  In  column  (12)  it  is  indicated  that  the  item  subscripted  10  within  the  ability  bank  is  to  have  1  as  its  subscript 
n  within  the  tailored  test.  As  can  be  noted  in  column  (11),  this  item  provided  the  minimum  expected  value  for 
the  variance  of  the  ability  estimate  given  the  p  items  in  the  ability  bank.  This  minimum  expected  value  was 
244.4,  thus  identifying  Item  1  in  the  tailored  test  as  Item  10  from  the  ability  bank.  According  to  convention, 
then,  g(1)  equals  10. 


Table  8.2.1 


Numerical  Summary  for  the  Choosing  of  Item  I 


(1) 

Item 

(g) 

(2) 

(6.1.1)° 

(3) 

hg(Vo) 

(6.1.3) 

(4) 

C8  i 

(6.1.6) 

(5) 

piz^e  |  v') 
(6.1.7) 

(6)  (7) 

y«  (Vo)  <£[?*(  v('))] 
(6.1.9)  (6.1.11) 

(8) 

px(K) 

(6.1.16) 

(9) 

Qgiy'o) 

(6.1.19) 

(10) 

W 

(6.1.14) 

(11)  (12) 
%ucP(G*  |  v'0,U'g)  n 
*  (6.2.1) 

1 

1.9600 

-1.9200 

.16 

.8908 

-1.7103 

.0924 

.9564 

.0436 

.9634 

384.2 

2 

2.3599 

-1.7100 

.23 

.9207 

-  1.5745 

.1155 

.9423 

.0577 

.9556 

374.2 

3 

1.8801 

-1.5000 

.21 

.8829 

-  1.3243 

.1660 

.9073 

.0927 

.9268 

356.7 

4 

2.4101 

-1.2900 

.22 

.9236 

-1.1915 

.1962 

.8833 

.1167 

.9090 

337.2 

5 

2.1000 

-1.0900 

.19 

.9029 

-.9841 

.2458 

.8375 

.1625 

.8684 

318.8 

6 

2.1600 

-  .9200 

.17 

.9075 

-.8349 

.2816 

.7981 

.2019 

.8324 

301.2 

7 

2.0599 

-.7400 

.22 

.8996 

- .6657 

.3197 

.7472 

.2528 

.8028 

303.2 

8 

2.3300 

-  .4900 

.15 

.9189 

-  .4503 

.3605 

.6737 

.3263 

.7227 

268.6 

9 

1 .8.499 

-  .2800 

.16 

.8797 

- .2463 

.3870 

.5973 

.4027 

.6617 

282.1 

10 

2.6099 

-.1100 

.11 

.9338 

-.1027 

.3968 

.5409 

.4591 

.5914 

244.4  1 

11 

2.0901 

1200 

.14 

.9021 

.1082 

.3966 

.4569 

.5431 

.5329 

275.4 

12 

2.5001 

.3100 

.22 

.9285 

.2878 

.3828 

.3867 

.6133 

.5217 

307.6 

13 

2.1900 

.5100 

.13 

.9097 

.4639 

.3582 

.3214 

.6786 

.4096 

296.7 

14 

2.0700 

.6900 

.20 

.9004 

.6213 

.3289 

.2672 

.7328 

.4138 

341.6 

15 

1.8000 

.9300 

.14 

.8742 

.8130 

.2867 

.2081 

.7919 

.3190 

349.4 

16 

2.2300 

1.0800 

.21 

.9125 

.9855 

.2455 

.1622 

.8378 

.3381 

382.3 

17 

1.8200 

1.3200 

.13 

.8764 

1.1569 

.2043 

.1237 

.8763 

.2376 

384.9 

18 

2.5300 

1.5300 

.20 

.9300 

1 .4229 

.1450 

.0774 

.9226 

.2619 

417.7 

19 

1.9701 

1.7000 

.16 

.8917 

1.5159 

.1265 

.0648 

.9352 

.2144 

420.8 

20 

2.2800 

1.9400 

.18 

.9158 

1 .7766 

.0823 

.0378 

.9622 

.2110 

434.2 

“Numbers  in  parentheses  indicate  the  equations  providing  the  column  entries. 
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This  individual  then  responds  with  a  correct  answer  to  Item  1.  Thus  the  outcome  vector  vj  contains  the 
entry  nj(10)  =  1,  where  the  tenth  item  in  the  ability  bank  has  been  aliased  by  the  subscript  1  within  the  tailored 
test.  Because  this  individual’s  answer  to  Item  1  was  correct,  the  estimate  of  ability  can  be  revised  by  using 
(6.2.2)  where  the  required  inputs  are  p{6*  \  v'0),  or  100,  of0*  |  v'0),  or  21.0819,  and  the  unrounded  values 
corresponding  to  the  entries  in  Table  8.2. 1  from  columns  (4),  (5),  (7),  and  (10),  for  g  equal  to  10,  the  subscript 
of  the  aliased  item.  In  this  case,  the  evaluation  of  (6.2.2)  yields  111.7567  as  the  updated  estimate  of  this 
individual’s  ability,  p.(0*  |  vj).  Accordingly,  the  variance  of  this  estimate  of  ability  can  be  revised  through  the 
use  of  (6.2.3),  where  the  required  inputs  are  cr2( 0 *  |  vj)  or  444.4444,  and  the  unrounded  values  corresponding 
to  the  entries  in  Table  8.2.1  from  columns  (4),  (5),  (6),  (7), and  (10)  for  g  equal  to  10,  the  subscript  of  the 
aliased  item.  In  this  case,  the  evaluation  of  (6.2.3)  provides  282.4501  as  the  updated  variance  of  this  estimate 
of  ability,  o^O*  |  v|).  The  error  of  this  estimate,  a(0*  |  vj),  is  therefore  16.8063.  Since  16.8063  is  greater 
than  6.6667  with  respect  to  the  comparison  in  (6.2.6),  which  does  not  satisfy  the  condition  stipulated  by  (6.2.6), 
the  testing  is  continued. 

Item  2  can  now  be  chosen.  In  Table  8.2.2  a  numerical  summary  is  presented  for  the  process  resulting  in 
the  choosing  of  Item  2.  Notice  that  there  are  no  entries  in  this  table  for  g(l)  or  g  equal  to  10,  because  Item  g(l) 
has  already  been  used  in  this  tailored  test.  In  column  (1)  the  subscripts  of  the  items  in  the  ability  bank  are 
presented.  Columns  (2),  (3),  and  (4)  provide  the  parameters  a?(vl),  bg(v |),  and  c^.  These  parameters  are 
appropriate  for  0*(v[)  or  standardized  ability  subsequent  to  the  incidental  effect  of  explicit  selection  on  Zl(10) 
as  specified  in  the  outcome  vector  v[ .  The  parameters  are  obtained  from  (6. 1 . 1),  (6. 1 .3),  and  (6. 1 .6)  for  n  equal 
to  2  where  each  of  the  unused  items  is  potentially  Item  2.  The  required  inputs  for  these  equations  are  a*  b * 
and  c*  as  given  in  Table  8.1.2,  and  fi( 6 *  |  vj)  and  a(0*  |  v[)  or  111.7567  and  16  8063,  respectively.  Column 
(5)  presents  the  correlation  between  Zg(v J)  and  0*(v|),  p(Zg,0  |  vj),  as  provided  by  (6.1.7)  for  n  equal  to  2; 
because  each  unused  item  in  the  ability  bank  is  potentially  Item  2.  The  point  of  dichotomization  on  Z^v',)— 
standardized  Zg(v[)  after  the  effect  of  incidental  selection  due  to  explicit  selection  on  Z1(10)— ,  y,(vj),  is  given 
in  column  (6).  This  point  of  dichotomization  is  obtained  most  readily  by  the  row-wise  multiplication  of  columns 
(3)  and  (5),  which,  within  rounding  error,  results  in  the  identical  output  of  (6. 1 .9)  under  the  circumstance  that 
Item  2  is  being  sought.  The  density  in  the  standard  normal  distribution  at  yg(v\),  (ply/v1,)],  is  given  in  column 
(7).  This  density  is  obtained  by  evaluating  (6.1.11)  for  n  equal  to  2.  The  probability  that  this  individual  will 
recognize  the  correct  answer  to  multiple-choice  item  g,  Pg(v\),  is  provided  in  column  (8)  and  is  obtained  from 
(6.1.16)  given  the  circumstance  that  Item  2  is  sought.  Column  (9)  presents  the  probability  that  this  individual 
will  not  recognize  the  correct  alternative  to  multiple-choice  item  g,  Qg(v |).  This  probability  is  obtained  most 


Table  8.2.2 


Numerical  Summary  for  the  Choosing  of  Item  2 


(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 

(10) 

(11) 

(12) 

Item 

a*(vl) 

W) 

C8 

p(Z^e\  v; 

)  ygW 

Pg(v\) 

Qg(v[) 

/>J) 

%u  ^(Q*  |  v\,U 

?)  n 

(£) 

(6.1.1)“ 

(6.1.3) 

(6.1.6) 

(6.1.7) 

(6-1.9) 

(6.1  11) 

(6.1  16) 

(6.1  19) 

(6.1.14) 

*  (6.2.1) 

I 

1 .5625 

-3.1080 

.16 

.8423 

-2.6178 

.0130 

.9956 

.0044 

.9963 

276.0 

2 

1.8813 

-2.8446 

.23 

.8830 

-2.5118 

.0170 

.9940 

.0060 

.9954 

274.2 

3 

1  4988 

-2.5812 

.21 

.8318 

-2.1471 

.0398 

.9841 

0159 

.9874 

266.9 

4 

1.9213 

-2.3177 

.22 

.8870 

-2.0559 

.0482 

.9801 

.0199 

.9845 

261.9 

5 

1.6741 

-2.0668 

.19 

.8585 

-1  7744 

.0826 

.9620 

.0380 

.9692 

251.2 

6 

1.7220 

-  1.8536 

17 

.8648 

—  1  6029 

.1104 

.9455 

.0545 

.9548 

241.4 

7 

1.6421 

-1.6278 

.22 

.8541 

-1.3903 

.1518 

.9178 

.0822 

.9359 

234.3 

8 

1.8574 

-  1.3142 

.15 

.8805 

-1.1572 

.2042 

.8764 

.1236 

.8949 

212.3 

9 

10 

1.4747 

-  1.0508 

16 

.8277 

-.8697 

.2733 

.8078 

.1922 

.8385 

207.1 

1 1 

1 .6662 

-.5490 

.14 

.8574 

-  .4707 

.3571 

.6811 

.3189 

.7257 

184.1 

I 

12 

1.9931 

-.3107 

.22 

.8938 

-.2777 

.3839 

.6094 

.3906 

.6953 

187.0 

13 

1.7458 

-.0598 

.13 

Mil 

-.0519 

.3984 

.5207 

.4793 

.5830 

177.4 

2 

14 

1 .6502 

.1660 

.20 

.8552 

.1420 

.3949 

.4436 

.5564 

.5548 

199.0 

15 

1.4349 

.4671 

14 

.8204 

.3832 

.3707 

.3508 

.6492 

.4417 

204.1 

16 

1.7778 

.6552 

.21 

.8716 

.5711 

.3389 

.2840 

.7160 

.4343 

219.8 

17 

1 .4509 

.9563 

.13 

.8234 

.7874 

.2926 

.2155 

.7845 

.3175 

225.2 

18 

2.0169 

1.2197 

.20 

.8959 

1.0928 

.2196 

.1373 

.8627 

.3098 

249.7 

19 

1.5705 

1 .4329 

.16 

.8435 

1.2087 

.1922 

.1134 

.8866 

.2552 

254.9 

20 

1.8176 

1.7340 

.18 

.8762 

1.5192 

.1258 

.0644 

.9356 

.2328 

269.5 

"Numbers  in  parentheses  indicate  equations  providing  the  column  entries. 
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readily  as  the  row-wise  complement  of  column  (8),  that  is  [1  /’s(Vi)],  which  is  identically  the  output  of 

(6.1.19)  for  this  circumstance.  Column  (10)  presents  the  probability  that  this  individual  will  obtain  a  correct 
answer  to  multiple-choice  item  g,  These  numerical  values  are  obtained  by  evaluating  (6. 1 . 14)  for  n  equal 

to  2  where  each  unused  item  in  the  ability  bank  is  potentially  Item  2.  In  column  (1 1)  one  has  the  expected  values 
of  the  variance  of  this  individual’s  ability  estimate,  a 2(0*  |  v\,Ug),  given  the  probable  outcomes  for  each 

unused  item.  Each  expected  value  is  obtained  from  (6.2.1)  using  ct2( G *  |  vj)  or  282.4501  and  the  row-wise 
entries  in  columns  (4),  (5),  (7),  (9),  and  (10)  as  inputs.  The  minimum  entry  in  column  (11)  is  found  in  order 
to  identify  Item  2,  the  most  informative  second  item  for  the  tailored  test.  When  responded  to  by  this  individual, 
Item  2  is  expected  to  reduce  most  the  variance  of  the  ability  estimate  or,  synonomously,  to  provide  the  maximum 
increase  in  precision  given  the  available  items.  The  minimum  value  ot  I"7?. 4  identifies  Item  13  from  the  ability 
bank  as  Item  2  in  the  tailored  test.  As  a  result,  a  2  is  recorded  in  column  12  and  row  13  of  Table  8.2.2.  According 
to  convention,  then,  g(2>  equals  13.  Under  the  selection  or  rejection  analogy,  explicit  selection  or  rejection  on 
Z203)  subsequent  to  explicit  selection  on  Zl(l0)  is  expected  to  restrict  most  the  variance  of  ability  for  the  selected 
or  rejected  subpopulation  if  explicit  selection  actually  occurred  in  this  sequence  on  ^(vj). 

This  individual  then  responds  with  a  correct  answer  to  Item  2.  Thus,  the  outcome  vector  v'2  contains  the 
entries  n;(l0)  =  1  and  u'2{i3)  =  1  where  the  tenth  and  thirteenth  items  in  the  ability  bank  have  been  aliased  by 
the  subscripts  1  and  2,  respectively,  within  the  tailored  test.  Because  this  individual’s  answer  to  Item  2  was 
correct,  the  estimate  of  ability  can  be  revised  using  (6.2.2)  where  the  required  inputs  are  p(G*  |  v',)  or  1 1 1 .7567, 
cr(0*  |  vj)  or  16.8063,  and  the  unrounded  values  corresponding  to  the  entries  in  Table  8.2.2  from  columns  (4), 
(5),  (7),  and  (10)  for  g  equal  to  13,  the  subscript  of  the  second  aliased  item.  In  this  case,  the  evaluation  of 

(6.2.2)  provides  120.4269  as  the  updated  estimate  of  this  individual’s  ability,  p(G*  \  v2).  Accordingly,  the 
variance  of  this  estimate  of  ability  can  be  revised  by  evaluating  (6.2.3)  where  the  required  inputs  are 
a^(G*  |  vj)  or  282.4501  and  the  unrounded  values  corresponding  to  the  entries  in  Table  8.2.2  from  columns 
(4),  (5),  (6),  (7),  and  (10)  for  n  equal  to  13,  the  subscript  of  the  second  aliased  item.  In  this  case,  the  use  of 

(6.2.3)  yields  200.7159  as  the  updated  variance  of  this  estimate  of  ability,  o2^ O *  |  v^).  The  error  of  this  estimate, 
oiO*  |  v2),  is  14.1674.  Since  14.1674  is  greater  than  6.6667  with  respect  to  the  comparison  given  in  (6.2.6), 
which  does  not  satisfy  the  condition  stipulated  in  (6.2.6),  testing  is  continued. 

The  third  item  can  now  be  chosen.  In  Table  8.2.3,  a  numerical  summary  is  presented  for  the  process 
resulting  in  the  choosing  of  Item  3.  Notice  that  there  are  no  entries  in  this  table  for  £(1)  or  g  equal  to  10  and  g{2) 
or  g  equal  to  13.  The  items  with  these  subscripts  are  ineligible  for  subsequent  use  in  this  tailored  test.  In  column 
(1),  the  subscripts  for  the  items  in  the  ability  bank  are  given.  Columns  (2),  (3),  and  (4)  present  the  parameters 


Table  8.2.3 


Numerical  Summary  for  the  Choosing  of  Item  3 


0) 

Item 

(g) 

(2) 

2 ) 

(6.1.1)° 

(3) 

(6  1  3) 

(4) 

Cft 

(6.1.6) 

(5) 

p(Zg,e  |  v^) 
(6.1.7) 

(6)  (7) 

Yd*’!)  <My*(^)] 

(6.1.9)  (6.1  11) 

(8) 

w 

(6.1.16) 

(9) 

Qgiv'i) 

(6.1.19) 

(10) 

W 

(6.1.14) 

01) 

1  W*) 
(6.2.1) 

1 

1.3171 

-4.2989 

.16 

.7965 

-3.4239 

.0011 

.9997 

.0003 

.9997 

200.3 

2 

1.5859 

-3.9864 

.23 

.8459 

-3.3720 

.0014 

.9996 

.0004 

.9997 

200.2 

3 

1.2635 

-3.6739 

.21 

.7841 

-2.8808 

.0063 

.9980 

.0020 

.9984 

198.8 

4 

1.6196 

-3.3614 

.22 

.8509 

-2.8602 

.0067 

.9979 

.0021 

.9983 

198.3 

5 

1.4112 

-3.0638 

.19 

.8159 

-2.4998 

.0175 

.9938 

.0062 

.9950 

195.3 

6 

1.4516 

-2.8108 

.17 

.8235 

-2.3147 

.0274 

.9897 

.0103 

.9914 

192.4 

7 

1.3843 

-2.5430 

.22 

.8106 

-2.0614 

0477 

.9804 

.0196 

.9847 

188.6 

8 

1.5658 

-2.1710 

.15 

.8428 

-1.8297 

.0748 

.9663 

.0337 

.9714 

180.0 

9 

1.2432 

-  1.8585 

.16 

.7792 

-  1.4481 

.1398 

.9262 

.0738 

.9380 

171.8 

10 

11 

1.4046 

-1.2633 

.14 

.8146 

-1.0291 

.2349 

.8483 

.1517 

.8695 

152.8 

12 

1.6801 

-  .9805 

.22 

.8593 

-  .8426 

.2797 

.8003 

.1997 

.8442 

147.1 

13 

14 

1.3911 

-.4151 

.20 

.8120 

-.3370 

.3769 

.6319 

.3681 

.7056 

142.8 

15 

1.2096 

-  .0579 

.14 

.7707 

-  .0447 

.3985 

.5178 

.4822 

.5853 

143.0 

16 

1  4986 

.1653 

.21 

.8318 

.1375 

.3952 

.4453 

.5547 

.5618 

145.7 

17 

1.2231 

.5224 

,13 

.7742 

.4044 

.3676 

.3429 

.6571 

.4284 

150.5 

18 

1.7002 

.8349 

.20 

.8620 

.7196 

.3079 

.2359 

.7641 

.3887 

162.6 

19 

1  3239 

1.0879 

.16 

.7980 

.8681 

.2737 

1927 

.8073 

.3218 

169.8 

20 

1.5322 

1.4450 

.18 

.8374 

1.2101 

.1918 

.1131 

.8869 

.2728 

183.2 

"Numbers  in  parentheses  indicate  the  equations  providing  the  column  entries. 


145 


ag(v 2)>  bg{v'2),  and  cg  for  these  eligible  items.  These  parameters  are  appropriate  for  0*(v2)  or  standardized  ability 
subsequent  to  the  incidental  effects  of  explicit  selections  on  Z1(10)(Vo),  and  Z2(  13)(v|)  as  specified  in  the  outcome 
vector  v2.  The  parameters  are  obtained  from  (6.1.1),  (6.1.3)  and  (6.1.6)  for  n  equal  to  3  where  each  of  the 
eligible  items  is  potentially  Item  3.  The  required  inputs  for  these  equations  are  a*,  b* ,  and  c*  as  provided  in 
Table  8.1.2,  and  /x(0*  |  v2)  and  a(0*  |  v2)  or  120.4269  and  14.1674,  respectively.  In  column  (5),  one  has  the 
correlation  between  Zg(v 2)  and  0*(v2),  p(Zg,0  |  v2),  as  given  by  (6.1.7)  because  each  unused  item  in  the  ability 
bank  is  potentially  Item  3.  The  point  of  dichotomization  on  the  continuous  variable  Zg(v2)— standardized  Z  (v2) 
after  the  effects  of  incidental  selection  due  to  the  explicit  selections  on  ZI(10)(v<j)  and  Z2(13)(v;)— ,  y  (v2),  is 
given  in  column  (6).  This  point  of  dichotomization  is  most  conveniently  obtained  by  the  row-wise  multiplication 
of  columns  (3)  and  (5)  which,  within  rounding  error,  results  in  the  identical  output  of  (6.1.9)  under  the  circum¬ 
stance  that  Item  3  is  being  sought.  The  density  in  the  standard  normal  distribution  at  y(?(v2),  <f>[yg(v2)],  is  provided 
in  column  (7).  This  density  is  obtained  by  evaluating  (6.1.11)  for  n  equal  to  3.  The  probability  that  this  individual 
will  recognize  the  correct  alternative  to  multiple-choice  item  g,  Pg{v2),  is  presented  in  column  (8)  and  is  obtained 
from  (6. 1.16)  given  the  circumstance  that  Item  3  is  sought.  Column  (9)  provides  the  probability  that  this  individual 
will  not  recognize  the  correct  alternative  to  multiple-choice  item  g,  Qg(v2).  This  probability  is  obtained  most 
readily  as  the  row-wise  complement  of  column  (8),  that  is  [1  -  Pg{v2)],  which  is  identically  the  output  of 
(6.1.19)  for  this  circumstance.  Column  (10)  provides  the  probability  that  this  individual  will  obtain  a  correct 
answer  to  multiple-choice  item  g,  P'g(v2).  These  numerical  values  are  obtained  by  evaluating  (6. 1 . 14)  for  n  equal 
to  3  where  each  unused  item  in  the  ability  bank  is  potentially  Item  3.  In  column  (1 1)  one  has  the  expected  values 
of  the  variance  of  this  individual’s  ability  estimate,  %v^o2{0*  |  v2,U'g ),  given  the  probable  outcomes  for  each 
unused  item.  Each  expected  value  is  obtained  from  (6.2.1)  using  cr2(0*  |  v2)  or  200.7159  and  the  row-wise 
entries  in  columns  (4),  (5),  (7),  (9),  and  (10)  as  inputs.  The  minimum  entry  in  column  (11)  is  found  in  order 
to  identify  Item  3,  the  most  informative  third  item  for  this  tailored  test.  When  responded  to  by  this  individual. 
Item  3  is  expected  to  most  reduce  the  variance  of  the  ability  estimate  or,  synonomously,  to  provide  the  maximum 
increase  in  its  precision.  The  minimum  value  of  142.8  identifies  Item  14  from  the  ability  bank  as  Item  3  in  this 
tailored  test.  As  a  result,  a  3  is  recorded  in  column(12)  and  row  14  of  Table  8.2.3.  Under  the  selection  or  rejection 
analogy,  explicit  selection  or  rejection  on  Z3(I4)(v2)  subsequent  to  the  explicit  selection  on  Zl(10)(vo)  and 
Z2(i3)(vi)  is  expected  to  restrict  most  the  variance  of  ability  for  the  selected  or  rejected  subpopulation  if  explicit 
selection  actually  occurred  in  this  sequence  on  Z3(14)(v2). 

This  individual  then  responds  with  an  incorrect  answer  to  Item  3.  Thus,  the  outcome  vector  vj  now 
contains  the  entries  ul(  10)  =  1,  w2()3)  =  1,  wj(14)  =  0  where  the  tenth,  thirteenth,  and  fourteenth  items  in  the 
ability  bank  have  been  aliased  by  the  subscripts  1,  2,  and,  3,  respectively,  within  this  tailored  test.  Because  this 
individual’s  answer  to  Item  3  was  incorrect,  the  estimate  of  ability  can  be  revised  by  evaluating  (6.2.4)  where 
the  required  inputs  are  /x(0*  |  v$)  or  120.4269,  a(0*  \  v'2)  or  14.1674,  and  the  entries  in  Table  8.2.3  from 
columns  (5),  (7),  and  (9)  for  g  equal  to  14,  the  subscript  of  the  third  aliased  item.  In  this  case,  the  evaluation 
of  (6.2.4)  yields  108.6462  as  the  updated  estimate  of  this  individual’s  ability, p,(0*  |  vj).  Accordingly,  the 
variance  of  this  estimate  of  ability  can  be  revised  through  the  use  of  (6.2.5)  where  the  required  inputs  are 
cP-iO*  |  v2)  or  200.7159  and  the  unrounded  values  corresponding  to  the  entries  in  Table  8.2.3  from  columns 
(5),  (6),  (7),  and  (9)  for  g  equal  to  14,  the  subscript  of  the  third  aliased  item.  In  this  case,  the  use  of  (6.2.5) 
provides  107.6038  as  the  updated  variance  of  the  estimate  of  ability,  o2(0*  |  vj).  The  error  of  this  estimate, 
a(0*  |  vj),  is  10.3732.  Since  10.3732  is  greater  than  6.6667  with  regard  to  the  comparison  given  in  (6.2.6), 
which  does  not  satisfy  the  stipulated  condition  of  (6.2.6),  the  testing  is  continued. 

The  fourth  item  can  now  be  chosen.  In  Table  8.2.4,  a  numerical  summary  is  provided  for  the  process 
leading  to  the  choosing  of  Item  4.  Notice  that  there  are  no  entries  in  this  table  for  g(l)  or  g  equal  to  10,  g(2)  or 
g  equal  to  13,  and  g(3>  or  g  equal  to  14.  These  items  are  ineligible  for  subsequent  use  in  this  tailored  test.  In 
column  (1),  the  subscripts  for  the  items  in  the  ability  bank  are  presented.  Columns  (2),  (3),  and  (4)  provide  the 
parameters  ag(v2),  bg(v2),  and  cg  for  these  eligible  items.  These  parameters  are  appropriate  for  0*(v3)  or 
standardized  ability  subsequent  to  the  incidental  effects  of  the  explicit  selections  on  Zl(10)(vo),  Z2(l3)(v|),  and 
Z3(i4)(v2)  as  specified  in  the  outcome  vector  vj.  The  parameters  are  obtained  from  (6.1.1),  (6.1.3),  and  (6.1.6) 
for  n  equal  to  4  where  each  of  the  eligible  items  is  potentially  Item  4.  The  required  inputs  for  these  equations 
are  a*,  b*,  and  c*  as  provided  in  Table  8.1.2,  p{0*  |  vj)  or  108.6462  and  a(0*  |  vj)  or  10.3732.  In  column 
(5),  one  has  the  correlation  between  Zg(v'3)  and  0*(vj),  p(Zg,0  |  vj),  as  given  by  (6.1.7),  because  each  unused 

item  in  the  ability  bank  is  potentially  Item  4.  The  point  of  dichotomization  on  the  continuous  variable  Z  (rj) _ 

standardized  Zg(v2)  after  the  effects  of  incidental  selection  due  to  the  explicit  selections  on  Zul0)(vo),  Z2(|3)(v|), 
and  Z3(i4)(v2) — ,  ys(v3),  is  given  in  column  (6).  This  point  of  dichotomization  is  most  readily  obtained  by  the 
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Table  8.2.4 

Numerical  Summary  for  the  Choosing  of  Item  4 


(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 

(10) 

(ID 

(12) 

Item 

p(ZH,0  |  v\) 

'  7v(v0 

My^)) 

PM) 

PM) 

'gt/<fT2(0*  |  v\,U'g) 

n 

0?) 

(6.1  i)M 

(6.1.3) 

(6.1.6) 

(6.1.7) 

(6.1.9) 

(6.1.11) 

(6.1.16) 

(6.1.19) 

(6.1.14) 

(6.2.1) 

1 

.9644 

-4.7356 

.16 

.6942 

-3.2873 

.0018 

.9995 

.0005 

.9996 

107.3 

2 

1.1612 

-4.3088 

.23 

.7577 

-3.2649 

.0019 

.9995 

.0005 

.9996 

107.3 

3 

.9251 

-3.8820 

.21 

.6791 

-2.6362 

.0124 

.9958 

.0042 

.9967 

106.2 

4 

1  1859 

-3.4552 

.22 

.7645 

-2.6414 

.0122 

.9959 

.0041 

.9968 

105.8 

5 

1.0333 

-3.0488 

.19 

.7186 

-2.1908 

.0362 

.9858 

.0142 

.9885 

103.4 

6 

1  0628 

-2.7033 

.17 

.7283 

-1.9688 

.0574 

.9755 

.0245 

.9797 

101.1 

7 

1.0136 

-2.3374 

.22 

.7119 

-1.6639 

.0999 

.9519 

.0481 

.9625 

98.4 

8 

1.1464 

-1.8294 

.15 

.7536 

-1.3786 

.1542 

.9160 

.0840 

.9286 

91.8 

9 

.9103 

-  1 .4026 

.16 

.6731 

-.9441 

.2555 

.8274 

.1726 

.8551 

89.5 

1 

10 

1 1 

1 .0284 

-  .5896 

.14 

.7169 

-  .4227 

.3648 

.6638 

.3362 

.7108 

81.1 

12 

13 

1.2302 

-  .2035 

.22 

.7760 

-.1579 

.3940 

.5627 

.4373 

.6589 

80.4 

4 

2 

14 

15 

.8857 

1.0566 

.14 

.6630 

.7005 

.3121 

.2418 

.7582 

.3480 

92.6 

3 

16 

1.0973 

1.3614 

.21 

.7391 

1.0062 

.2405 

.1572 

.8428 

.3342 

98.1 

17 

.8955 

1.8492 

.13 

.6671 

1.2336 

.1864 

.1087 

.8913 

.2245 

100.4 

18 

1.2449 

2.2760 

.20 

.7796 

1 .7744 

.0826 

.0380 

.9620 

.2304 

106.0 

19 

.9694 

2.6215 

.16 

.6960 

1.8246 

.0755 

.0340 

.9660 

.1886 

106.2 

20 

1.1219 

3.1092 

.18 

.7465 

2.3210 

.0270 

.0101 

.9899 

.1883 

107.4 

— 

“Numbers  in  parentheses  indicate  the  equations  providing  the  column  entries. 


row-wise  multiplication  of  the  entries  in  columns  (3)  and  (5),  an  operation  which,  within  rounding  error,  provides 
an  output  identical  to  that  of  (6.1.9)  under  the  circumstance  that  Item  4  is  being  sought.  The  density  in  the 
standard  normal  distribution  at  y*(vj),  *[yg(v5)],  is  presented  in  column  (7).  This  density  is  obtained  by  evaluating 
(6.1.11)  for  n  equal  to  4.  The  probability  that  this  individual  will  recognize  the  correct  alternative  to  multiple- 
choice  item  g,  Pg(v 3),  is  presented  in  column  (8)  and  is  obtained  from  (6. 1 . 16)  under  the  circumstance  that  Item 
4  is  sought.  Column  (9)  provides  the  probability  that  this  individual  will  not  recognize  the  correct  alternative  to 
multiple-choice  item  g,  Qg(v 3).  This  probability  is  obtained  most  conveniently  as  the  row-wise  complement  of 
column  (8),  that  is  [1  -  Ps(vj)],  which  results  in  the  identical  output  of  (6. 1 . 19)  for  this  circumstance.  Column 
(10)  presents  the  probability  that  this  individual  will  obtain  a  correct  answer  to  multiple-choice  item  g,  P'g(v 3). 
In  obtaining  these  numerical  values,  (6.1.14)  is  evaluated  for  n  equal  to  4  where  each  unused  item  in  the  ability 
bank  is  potentially  Item  4.  Column  (11)  provides  the  expected  values  of  the  variance  of  this  individual’s  ability 
estimate,  %u  o2(Q*  \  v'3,U'g),  given  the  probable  outcomes  for  each  unused  item  in  the  ability  bank.  Each 
expected  value  is  obtained  by  evaluating  (6.2.1)  where  the  required  inputs  are  c^O*  |  vj)  or  107.6038  and  the 
row-wise  entries  in  columns  (4),  (5),  (7),  (9),  and  (10).  The  minimum  entry  in  column  (11)  is  found  in  order 
to  identify  Item  4,  the  most  informative  fourth  item  for  this  tailored  test.  When  responded  to  by  this  individual, 
Item  4  is  expected  to  reduce  most  the  variance  of  the  ability  estimate  given  the  eligible  items.  Synonomously, 
Item  4  is  expected  to  provide  the  maximum  increase  in  precision,  given  the  available  items.  The  minimum  value 
of  80.4  identifies  Item  12  from  the  ability  bank  as  Item  4  in  this  tailored  test.  Therefore,  a  4  is  recorded  in 
column  12  and  row  12  of  Table  8.2.4.  Under  the  selection  or  rejection  analogy,  explicit  selection  or  rejection 
on  Z4(12)(vj)  subsequent  to  explicit  selections  on  Z1(10)(vo)  and  Z2(13)(vi)  and  explicit  rejection  on  Z3(l4)(v2)  is 
expected  to  restrict  most  the  variance  of  ability  for  the  selected  or  rejected  subpopulation  if  explicit  selection 
actually  occurred  in  this  sequence  on  Z4(12)(vj). 

This  individual  then  responds  with  an  incorrect  answer  to  Item  4.  Therefore,  the  outcome  vector  vj 
contains  the  entries  «J(I0)  =  1,  «2(i3)  =  ■>  UW)  =  0),  and  u'M]2)  =  0  where  the  tenth,  thirteenth,  fourteenth, 
and  twelfth  items  in  the  ability  bank  have  been  aliased  by  the  subscripts  1,  2,  3,  and  4,  respectively,  within  this 
individual’s  tailored  test.  Because  this  individual’s  answer  to  Item  4  was  incorrect,  the  estimate  of  ability  can 
be  revised  by  evaluating  (6.2.4)  where  the  required  inputs  are  p.(0*  |  vj)  or  108.6462,  cr(Q*  |  vj)  or  10.3732, 
and  the  unrounded  values  corresponding  to  the  entries  in  Table  8.2.4  from  columns  (5),  (7),  and  (9)  for  g  equal 
to  12,  the  subscript  of  the  fourth  aliased  item.  In  this  case,  the  evaluation  of  (6.2.4)  yields  101.3935  as  the 
updated  estimate  of  this  individual’s  ability,  p.(0*  \  v'4).  Accordingly,  the  variance  of  this  estimate  of  ability 
can  be  revised  through  the  use  of  (6.2.5)  where  the  required  inputs  are  c^iQ*  |  vj)  or  107.6038  and  the  unrounded 
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values  corresponding  to  the  entries  in  Table  8.2.4  from  columns  (5),  (6),  (7),  and  (9)  for  n  equal  to  12,  the 
subscript  of  the  fourth  aliased  item.  In  this  case,  the  use  of  (6.2.5)  provides  64.2195  as  the  updated  variance  of 
this  estimate  of  ability,  o2(0*  |  v'4).  The  error  of  this  estimate,  a(G*  |  v4),  is  8.0137.  Since  8.0137  is  greater 
than  6.6667  with  regard  to  the  comparison  given  in  (6.2.6),  which  does  not  satisfy  the  condition  stipulated  in 
(6.2.6),  the  testing  of  this  individual  is  continued. 

The  fifth  item  can  now  be  chosen.  In  Table  8.2.5,  a  numerical  summary  is  presented  for  the  process 
leading  to  the  choosing  of  Item  5.  Notice  that  there  are  no  entries  in  this  table  for  £(1)  or  g  equal  to  10,  g(2)  or 
g  equal  to  13,  gl3)  or  g  equal  to  14,  and  g(4)  or  g  equal  to  12.  These  items  are  ineligible  for  subsequent  use  in 
this  tailored  test.  In  column  (1),  the  subscripts  for  the  items  in  the  ability  bank  are  presented.  The  parameters 
a^(v4),  bg(yA)  and  cg  are  presented  in  columns  (2),  (3),  and  (4)  for  the  eligible  items.  These  parameters  are 
appropriate  for  0*(v4)  or  standardized  ability  subsequent  to  the  incidental  effects  of  explicit  selections  on  Zl(IO)(vo), 
Z3(14)(v2),  and  Z4(12)(v3)  as  specified  in  the  outcome  vector  v4.  The  parameters  are  obtained  from 
(6.1.1),  (6.1.3),  and  (6.1.6)  for  n  equal  to  5  where  each  of  the  unused  or  eligible  items  is  potentially  Item  5. 
The  required  inputs  for  these  equations  are  a*,  b*,  and  c*  as  provided  in  Table  8. 1 .2,  p(0*  |  v^)  or  101.3935 
and  <x(0*  |  v4)  or  8.0137.  In  column  (5),  one  has  the  correlation  between  Z„(v4)  and  0*(v4),  p(Z,,0  |  v4),  as 
given  by  (6.1.7)  because  as  of  now  each  unused  item  in  the  ability  bank  is  potentially  Item  5.  The  point  of 
dichotomization  on  the  continuous  variable  Zg(v\)— standardized  Zg(v4)  given  the  effects  of  incidental  selection 
due  to  explicit  selections  on  Z1(|0)(v0),  Z2(1 3)(v|),  Z3(]4)(v2),  and  Z4(12)(v3) — ,  ys(v4),  is  provided  in  column  (6). 
This  point  of  dichotomization  is  most  readily  obtained  by  the  row-wise  multiplication  of  the  entries  in  columns 
(3)  and  (5),  an  operation  that,  within  rounding  error,  provides  an  output  identical  to  that  of  (6.1.9)  under  the 
circumstance  that  Item  5  is  being  sought.  The  density  in  the  standard  normal  distribution  at  yx(v4),  <£[y„(v4)], 
is  provided  in  column  (7).  This  density  is  obtained  by  evaluating  (6.1.11)  for/t  equal  to  5.  The" probability  that 
this  individual  will  recognize  the  correct  alternative  to  multiple-choice  item  g,  Px(y4)  is  given  in  column  (8)  and 
is  obtained  from  (6.1.16)  under  the  circumstance  that  Item  5  is  sought.  Column  (9)  provides  the  probability  that 
this  individual  will  not  recognize  the  correct  alternative  to  multiple-choice  item  g,  Qg{v4).  This  probability  is 
obtained  most  conveniently  as  the  row-wise  complement  of  column  (8),  that  is  [1  -  /\,(v4)],  which  results  in 
the  identical  output  of  (6.1.19)  for  this  circumstance.  Column  (10)  provides  the  probability  that  this  individual 
will  obtain  a  correct  answer  to  multiple-choice  item  g,  Pj)(v4).  In  obtaining  these  numerical  values,  (6.1.14)  is 
evaluated  for  n  equal  to  5  where  each  eligible  item  in  the  ability  bank  is  potentially  Item  5.  In  column  (1 1),  one 
has  the  expected  values  of  the  variance  of  this  individual’s  ability  estimate,  %u .  c^O*  |  v^, (/',),  given  the  probable 
outcomes  for  each  eligible  item.  Each  expected  value  is  obtained  by  evaluating  (6.2.1)  where  the  required  inputs 


Table  8.2.5 

Numerical  Summary  for  the  Choosing  of  Item  5 


0)  (2)  (3)  (4)  (5) 


Item 

(8) 

(6.1.1)“ 

(6.1.3) 

(6.1.6) 

p(Z,,e|  i 
(6.1.7) 

1 

.7450 

-5.2249 

.16 

.5974 

2 

.8971 

-4.6724 

.23 

.6678 

3 

.7147 

-4.1200 

.21 

.5814 

4 

.9161 

-3.5675 

.22 

.6755 

5 

.7982 

-3.0414 

19 

.6239 

6 

.8211 

-2.5942 

.17 

.6346 

7 

.7830 

-2.1206 

.22 

.6165 

8 

.8857 

-  1  4629 

.15 

.6630 

9 

10 

.7032 

-.9105 

.16 

.5752 

11 

.7945 

.1418 

.14 

.6221 

12 


13 

14 


15 

.6842 

2.2727 

.14 

.5647 

16 

.8477 

2.6673 

.21 

.6466 

17 

.6918 

3.2987 

.13 

.5689 

18 

.9617 

3.8511 

.20 

.6932 

19 

.7489 

4.2983 

.16 

.5994 

20 

.8667 

4.9297 

.18 

.6549 

“Numbers  in  parentheses  indicate  the  equations 


(6) 

1)  y *K) 

(6.1.9) 

(7) 

(6.1.11) 

(8) 

Pg«) 

(6.1.16) 

(9) 

QgW) 

(6.1.19) 

(10) 

W) 

(6.1.14) 

-3.1216 

.0031 

.9991 

.0009 

.9992 

-3.1200 

.0031 

.9991 

.0009 

.9993 

-2.3955 

.0226 

.9917 

.0083 

.9934 

-2.4099 

.0219 

.9920 

.0080 

.9938 

-1.8974 

.0659 

.9711 

.0289 

.9766 

-  1.6462 

.1029 

.9501 

.0499 

.9586 

-  1.3074 

.1697 

.9045 

.0955 

.9255 

-  .9700 

.2492 

.8340 

.1660 

.8589 

-.5237 

.3478 

.6998 

.3002 

.7478 

.0882 

.3974 

.4649 

.5351 

.5398 

1.2833 

.1751 

.0997 

.9003 

.2257 

1.7247 

.0901 

.0423 

.9577 

.2434 

1.8767 

.0686 

.0303 

.9697 

.1563 

2.6695 

.0113 

.0038 

.9962 

.2030 

2.5765 

.0144 

.0050 

.9950 

.1642 

3.2287 

.0022 

.0006 

.9994 

.1805 

providing  the  column  entries. 


(11) 

%uy(B*  I  vfU'g) 
(6.2.1) 


64.0 

64.0 

63.2 

62.8 

61.1 

59.5 
58.0 
53.8 

54.6 

52.5 


61.6 

63.5 

63.7 

64.2 

64.2 

64.2 


(12) 

n 


1 

5 

4 

2 
3 
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are  o2^ O *  |  V4)  or  64.2195  and  the  row-wise  entries  in  columns  (4),  (5),  (7),  (9),  and  (10).  The  minimum  entry 
in  column  (11)  is  sought  in  order  to  identify  the  most  informative  fifth  item  for  this  tailored  test.  The  minimum 
value  of  52.5  identifies  Item  11  from  the  ability  bank  as  Item  5  in  this  tailored  test.  Thus,  a  5  is  recorded  in 
column  12  and  row  11  of  Table  8.2.5.  Under  the  selection  or  rejection  analogy,  explicit  selection 
or  rejection  on  2*1  i^( V4)  subsequent  to  explicit  selections  on  Z1(10)(vo)  and  Z2(13)(vi)  and  explicit  rejections  on 
Z}(i4)(v2)  and  Z4(12)(v3)  is  expected  to  restrict  most  the  variance  of  ability  for  the  selected  or  rejected  subpopulation 
if  explicit  selection  on  Z50  d(v4)  actually  occurred  in  this  sequence. 

This  individual  then  responds  with  an  incorrect  answer  to  Item  5.  Hence,  the  outcome  vector  Vg  contains 
the  entries  =  1,  «2<i3>  =  1,  m3(]4)  ~  0,  w4(i2)  =  and  w5(n>  =  0  where  the  tenth,  thirteenth,  fourteenth, 

twelfth,  and  eleventh  items  in  the  ability  bank  have  been  aliased  by  the  subscripts  1,  2,  3,  4,  and  5,  respectively, 
within  this  tailored  test.  Because  this  individual’s  answer  to  Item  5  was  incorrect,  the  estimate  of  ability  can  be 
revised  by  evaluating  (6.2.4)  where  the  required  inputs  are  jjl(Q*  |  v4)  or  101.3935,  cr(0*  |  v4)  or  8.0137,  and 
the  unrounded  values  corresponding  to  the  entries  in  Table  8.2.5  from  columns  (5),  (7)  and  (9)  for  g  equal  to 
11,  the  subscript  of  the  fifth  aliased  item.  In  this  case,  the  evaluation  of  (6.2.4)  yields  97.6917  as  the  updated 
estimate  of  this  individual’s  ability,  p(Q*  |  Vg).  Accordingly,  the  variance  of  this  estimate  of  ability  can  be 
revised  through  the  use  of  (6.2.5)  where  the  required  inputs  are  or2( 0 *  |  v4)  or  64.2195  and  the  unrounded  values 
corresponding  to  the  entries  in  Table  8.2.5  from  columns  (5),  (6),  (7),  and  (9)  for  n  equal  to  1 1,  the  subscript 
of  the  fifth  aliased  item.  In  this  case,  the  use  of  (6.2.5)  yields  48.8885  as  the  updated  variance  of  this  estimate 
of  ability,  |  Vg).  The  error  of  this  estimate,  cr(0*  |  Vg),  is  6.9920.  Since  6.9920  is  greater  than  6.6667 

with  respect  to  the  comparison  given  in  (6.2.6),  which  does  not  satisfy  the  condition  stipulated  in  (6.2.6),  the 
testing  is  continued. 

The  sixth  item  can  now  be  chosen.  In  Table  8.2.6,  a  numerical  summary  is  provided  for  the  process 
resulting  in  the  choosing  of  Item  6.  Notice  that  there  are  no  entries  in  this  table  for  g(1)  or  g  equal  to  10,  g(2)  or 
g  equal  to  13,  g(3)  or  g  equal  to  14,  g(4)  or  g  equal  to  12,  and  g{5)  or  g  equal  to  1 1.  These  items  are  ineligible 
for  subsequent  use  in  this  tailored  test.  In  column  (1),  the  subscripts  for  the  eligible  as  well  as  the  ineligible 
items  in  the  ability  bank  are  presented.  The  parameters  a^(vg),  b^(vg)  and  cg  for  the  eligible  items  are  provided 
in  columns  (2),  (3),  and  (4).  These  parameters  are  appropriate  for  0*(vg)  or  standardized  ability  subsequent  to 
the  incidental  effects  of  explicit  selections  on  ZI(10)(vo),  Z2n3)(vJ),  Z3(i4)(v2),  Z402)(v3),  and  Z5(11)(v4)  as  specified 
in  the  outcome  vector  Vg.  The  parameters  are  obtained  from  (6.1.1),  (6.1.3),  and  (6.1.6)  for  n  equal  to  6  where 
each  of  the  unused  or  eligible  items  is  potentially  Item  6.  The  required  inputs  for  these  equations  are  a*,  /?*, 
and  c*  as  provided  in  Table  8. 1  =2,  p(0*  |  Vg)  or  97.6917,  and  cr(Q*  |  Vg)  or  6.9920.  In  column  (5),  the  correlation 


Table  8.2.6 

Numerical  Summary  for  the  Choosing  of  Item  6 


(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 

(10) 

(11) 

(12) 

Item 

cg 

p(Z„0\  vj) 

y*M) 

4>[y^)] 

W) 

QM) 

w 

%V'<jr{Q*  v\,U’g) 

n 

(2) 

(6.1. ir 

(6.1.3) 

(6.1.6) 

(6.1.7) 

(6.1  9) 

(6.1.11) 

(6.1.16) 

(6.1.19) 

(6.1.14) 

'  (6.2.1) 

1 

.6500 

-5.4589 

.16 

.5450 

-2.9752 

.0048 

.9985 

.0015 

.9988 

48.7 

2 

.7827 

-4.8257 

.23 

.6163 

-2.9743 

.0048 

.9985 

.0015 

.9989 

48.7 

3 

.6235 

-4.1926 

.21 

.5291 

-2.2183 

.0341 

.9867 

.0133 

.9895 

47.9 

4 

.7993 

-3.5594 

.22 

.6244 

-2.2224 

.0338 

.9869 

.0131 

.9898 

47.6 

5 

.6965 

-2.9564 

.19 

.5715 

-1.6896 

.0957 

.9544 

.0456 

.9631 

46.2 

6 

.7164 

-2.4438 

.17 

.5824 

-1.4232 

.1449 

.9227 

.0773 

.9358 

44.9 

7 

.6832 

-1.9011 

.22 

.5641 

-  1 .0724 

.2245 

.8582 

.1418 

.8894 

44.0 

8 

.7728 

-1.1473 

.15 

.6115 

-.7015 

.3119 

.7585 

.2415 

.7947 

41.0 

6 

9 

10 

.6136 

-.5141 

.16 

.5230 

-  .2689 

.3848 

.6060 

.3940 

.6690 

42.6 

1 

11 

12 

5 

4 

13 

2 

14 

3 

15 

.5970 

3.1342 

.14 

.5126 

1.6066 

.1098 

.0541 

.9459 

.1865 

48.1 

16 

.7396 

3.5865 

.21 

.5946 

2.1327 

.0410 

.0165 

.9835 

.2230 

48.8 

17 

.6036 

4.3101 

.13 

.5168 

2.2273 

.0334 

.0130 

.9870 

.1413 

48.8 

18 

.8391 

4.9433 

.20 

.6428 

3.1775 

.0026 

.0007 

.9993 

.2006 

48.9 

19 

.6534 

5.4558 

.16 

.5470 

2.9843 

.0046 

.0014 

.9986 

.1612 

48.9 

20 

.7562 

6.1795 

.18 

.6032 

3.7272 

.0004 

.0001 

.9999 

.1801 

48.9 

“Numbers  in  parentheses  indicate  the  equations  providing  the  column  entries. 
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between  Zg(v'5)  and  0*(v'5),  p(Zg,0  |  V5),  is  presented.  This  correlation  is  obtained  from  (6.1.7)  for  n  equal  to 
6  because  each  unused  item  in  the  ability  bank  is  potentially  Item  6.  The  point  of  dichotomization 
on  the  continuous  variable  Z^)— standardized  Zg(v'5)  after  the  effects  of  incidental  selection  due  to  explicit 
selections  on  Z1(10)(Vo),  Z>( i3)(vi)>  -^3(i4)(v2)>  ^4<i2)(v3)>  and  Z5(ll }( vi) — ,  is  provided  in  column  (6).  This 

point  of  dichotomization  can  be  conveniently  obtained  through  the  row-wise  multiplication  of  the  entries  in 
columns  (3)  and  (5).  This  multiplication  provides,  within  rounding  error,  an  output  that  is  equal  to  that  of  (6. 1 .9) 
given  the  circumstance  that  Item  6  is  being  sought.  The  density  of  the  standard  normal  distribution  at  yg(v'5), 
is  presented  in  column  (7).  This  density  is  obtained  through  evaluating  (6.1.1 1)  for  n  equal  to  6.  The 
probability  that  this  individual  will  recognize  the  correct  alternative  to  multiple-choice  item  g,  Pg{v'5),  is  given 
in  column  (8).  This  probability  can  be  obtained  from  (6.1.16)  given  that  Item  6  is  sought.  The  probability  that 
this  individual  will  not  recognize  the  correct  alternative  to  multiple-choice  item  g,  Qg(v'5),  is  provided  in  column 

(9) .  This  probability  can  be  most  readily  obtained  as  the  row-wise  complement  of  column  (8),  that  is, 
[1  -  PS(V5)].  This  complement  is  identically  the  output  of  (6.1.19)  for  this  circumstance.  The  probability  that 
this  individual  will  obtain  a  correct  answer  to  multiple-choice  item  g,  Pg(v$),  is  presented  in  column  (10).  In 
obtaining  these  numerical  values,  (6.1.14)  is  evaluated  for  n  equal  to  6  for  each  available  item  in  the  ability 
bank.  In  column  (11),  one  has  the  expected  values  of  the  variance  of  this  individual’s  ability  estimate, 

oP(0*  |  v'5,U'g),  given  the  probable  outcomes  for  each  available  item.  Each  expected  value  is  obtained  by 
evaluating  (6.2.1)  where  the  required  inputs  are  cP(6*  |  V5)  or  48.8885  and  the  row-wise  entries  in  columns 

(4) ,  (5),  (7),  (9),  and  (10).  The  minimum  entry  in  column  (1 1)  is  located  in  order  to  identify  the  most  informative 
sixth  item  for  this  tailored  test.  The  minimum  value  of  41.0  identifies  Item  8  from  the  ability  bank  as  Item  6  in 
this  tailored  test.  Therefore,  a  6  is  recorded  in  column  12  and  row  8  of  Table  8.2.6.  Under  the  selection  or 
rejection  analogy,  explicit  selection  or  rejection  on  Z6(8)(v5)  subsequent  to  explicit  selections  on  Z1(H))(vo)  and 
Z,03)(vi)  and  explicit  rejections  on  Z3(14)(v2),  Z4(,2)(vj),  and  ^5(1!  is  expected  to  restrict  most  the  variance 
of  ability  for  the  selected  or  rejected  subpopulation  if  explicit  selection  on  Z6{%)(v'5)  actually  occurred  in  this 
sequence. 

This  individual  then  responds  with  a  correct  answer  to  Item  6.  Thus  the  outcome  vector  contains  the 
entries:  m|(10)  =  1,  «2(i3)  =  w3<i4>  =  0,  ti'4(l2)  =  0,  u'5(U)  =  0,  and  u'6(S)  =  1  where  the  tenth,  thirteenth, 

fourteenth,  twelfth,  eleventh,  and  eighth  items  in  the  ability  bank  have  been  aliased  by  the  subscripts  1,  2,  3, 
4,  5,  and  6  within  this  tailored  test.  Because  this  individual’s  answer  to  Item  6  was  correct,  the  estimate  of 
ability  can  be  revised  by  evaluating  (6.2.2)  where  the  required  inputs  are  p,(Q*  |  V5)  or  97.6917,  cr(0*  |  V5)  or 
6.9920,  and  the  unrounded  values  corresponding  to  the  entries  in  Table  8.2.6  from  columns  (4),  (5),  (7),  and 

(10)  for  g  equal  to  8,  the  subscript  of  the  sixth  aliased  item.  In  this  case,  the  evaluation  of  (6.2.2)  yields  99. 1 180 
as  the  updated  estimate  of  this  individual’s  ability,  ^i(0*  |  v^).  Accordingly,  the  variance  of  this  estimate  of 
ability  can  be  revised  through  the  use  of  (6.2.3)  where  the  required  inputs  are  ^(0*  |  V5)  or  48.8885,  and  the 
unrounded  values  corresponding  to  the  entries  in  Table  8.2.6  from  columns  (4),  (5),  (6),  (7),  and  (10)  for  g 
equal  to  8,  the  subscript  of  the  sixth  aliased  item.  In  this  case  the  use  of  (6.2.3)  yields  42.5762  as  the  updated 
variance  of  the  estimate  of  ability,  0^(0*  |  v^),  The  error  of  this  estimate,  cr(0*  |  v'6),  is  6.5250.  Since  6.5250 
is  less  than  6.6667  with  respect  to  the  comparison  given  in  (6.2.6),  which  now  satisfies  the  condition  stipulated 
in  (6.2.6),  the  test  is  concluded.  The  item  subscript  at  the  termination  of  testing  for  this  individual,  qh  is,  thus, 
6. 

8.3.  Summary  of  Test  Results 

In  Table  8.3.1,  a  summary  is  presented  for  the  test  that  was  tailored  to  this  individual.  Column  (1) 
provides  the  order  in  which  items  were  chosen  and  presented  within  the  tailored  test.  This  order  of  presentation 
was  indexed  by  the  subscript  n .  In  column  (2),  the  subscripts  g(n)  are  presented  for  the  items  chosen  from  the 
ability  bank  to  form  this  tailored  test.  The  individual’s  binary  scores  on  the  chosen  items,  u'n[g{n) j,  are  recorded 
in  column  (3).  In  column  (4),  the  /x(0*  |  v'),  the  estimates  of  this  individual’s  ability  are  given.  The  variances 
of  these  estimates,  the  0^(0*  |  v^),  and  the  errors  of  these  estimates,  the  cr(0*  |  v'),  are  presented  in  columns 

(5)  and  (6),  respectively.  In  the  row  where  n  equals  0,  the  initial  estimate  of  the  individual’s  ability,  /x(0*  |  Vq) 
or  100.0000,  the  variance  of  this  estimate,  0^(0*  |  Vq )  or  444.4444,  and  the  error  of  this  estimate,  cr(0*  |  Vq) 
or  21 .0819,  are  recorded.  In  the  row  where  n  equals  1 ,  and  reading  from  left  to  right,  the  following  are  recorded: 
the  ability  bank  subscript  for  Item  1,  10;  this  individual’s  binary  score  on  Item  1  or  Item  10  from  the  ability 
bank,  u[(l0)  or  1;  the  estimate  of  this  individual’s  ability  given  the  binary  score,  /x(0*  |  vj)  or  111.7567;  the 
variance  of  this  ability  estimate  given  this  binary  score,  0^(0*  |  vj)  or  282.4501;  and  the  error  of  this  ability 
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Table  8.3.1 

A  Summary  of  the  Tailored  Test  for  Individual  i 


(1) 

Item 

(«) 

(2) 

(3) 

(4) 

/x(0*  |  v,',) 

(5) 

cFtO*  |  v») 

(6) 

<7(6*  \  v'„) 

0 

100.0000 

444.4444 

21.0819 

1 

10 

1 

111.7567 

282.4501 

16.8063 

2 

13 

1 

120.4269 

200.7159 

14.1674 

3 

14 

0 

108.6462 

107.6038 

10.3732 

4 

12 

0 

101.3935 

64.2195 

8.0137 

5 

11 

0 

97.6917 

48.8885 

6.9920 

6 

8 

1 

99.1180 

42.5762 

6.5250 

Note . 

<7/  =  6,  /xj (0*  | 

e 2  =  (6.6667)2 

vi.)  =  99.1180,  o-?(0*  I  v'u) 
=  '44.4448  =  (.1000)  0^(0* 

=  42.5762  =  (.0958)  <^(0* 

1  v«)- 

1  Vo), 

estimate  given  the  binary  score,  t r(0*  |  vj)  or  16.8063.  Notice  in  this  tabular  presentation  that  the  outcome 
vector,  vfq.,  is  summarized  in  a  sequential  or  row-wise  fashion  in  columns  (1),  (2),  and  (3).  For  instance,  the 
second  entry  in  this  vector  was  (4(13)  =  1  which  is  identically  the  information  recorded  in  columns  (1),  (2),  and 
(3)  in  the  row  where  n  equals  2.  The  other  entries  in  this  row  are:  the  individual’s  ability  estimate  after  two 
items  |  v'f)  or  120.4269;  the  variance  of  this  estimate  0^(0*  |  v£)  or  200.7159;  and  the  error  of  this  estimate 
cr(0*  I  4)  or  14.1674.  Accordingly,  the  third  entry  in  the  outcome  vector,  Vq.,  was  u'W)  =  0  which  is  identically 
the  information  contained  in  columns  (1),  (2),  and  (3)  in  the  row  where  n  equals  3.  The  other  entries  in  this 
row  are:  ^i(0*  |  V3)  or  108.6462,  the  individual’s  ability  estimate  after  three  items;  cr2(0*  |  V3)  or  107.6038, 
the  variance  of  this  ability  estimate;  and  cr(0*  |  V3)  or  10.3732,  the  error  of  this  ability  estimate.  Analogous 
interpretations  apply  with  respect  to  the  remaining  rows  in  Table  8.3.1.  However,  the  row  where  n  corresponds 
to  — 6  for  this  individual — has  added  significance.  The  entry  in  this  row  and  in  column  (4)  or  99. 1 180  is  this 
individual’s  “official”  estimate  of  ability  since  its  associated  error  or  6.5250  was  less  than  e  or  6.6667. 
The  value  of  e  is  the  specified  level  of  precision.  In  column  (5)  of  this  row,  a  within-individual  variance  of 
42.5762  is  reported.  This  numerical  value  corresponds  to  (.0958)  <^(0*  |  Vq)  which  closely  approximates 
(.1000)  0^(0*  |  v6),  or  e2,  44.4448.  The  squared  terminal  error  e2  sets  the  lower  bound  to  the  index  of  reliability 
for  the  results  obtained  through  the  tailored  testing  process.  The  lower  bound  to  the  index  of  reliability  as  well 
as  its  implications  for  practice  was  discussed  earlier  in  Chapter  7. 
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